00000001:02000400:3.0F:1789135592.450016:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789135611.528320:0:3514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1789135614.011999:0:3558:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 292 MB/s 00000001:01000000:3.0:1789135614.262595:0:3558:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 567 MB/s 00000001:01000000:2.0F:1789135614.512093:0:3558:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5055 MB/s 00000020:02000000:0.0F:1789135615.282071:0:3607:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_127_ged01a19 00000400:02000000:3.0:1789135615.963523:0:3622:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.131@tcp [8/256/0/180] 00008000:02000000:1.0:1789135620.164188:0:3771:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789135698.976775:0:5741:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789135717.359763:0:6492:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789135717.359770:0:6492:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789135717.359772:0:6492:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789135717.360181:0:6492:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000045165197 00000080:02000400:1.0:1789135717.360192:0:6492:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789135717.365698:0:6492:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789135717.365707:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789135717.365734:0:6492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004f527f37) 00000020:00000080:1.0:1789135717.365750:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789135717.431165:0:6492:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789135717.432978:0:6492:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789135717.482442:0:6492:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789135717.482687:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789135717.482696:0:6492:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789135717.482709:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de24b3 00000020:01000004:1.0:1789135717.482715:0:6492:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789135717.482719:0:6492:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789135717.482724:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000045165197 from MGS 00000020:01000004:1.0:1789135717.482729:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789135717.482739:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000037016916) 00000020:00000080:1.0:1789135717.482747:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789135717.482803:0:6492:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045165197 from MGS, refs=2 00080000:01000000:1.0:1789135717.482808:0:6492:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789135717.482813:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de24c1 00000100:00100000:1.0:1789135717.482999:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789135717.483148:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789135717.483154:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789135717.486631:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789135717.486648:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789135717.488491:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135717.488755:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789135717.488775:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789135717.492062:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789135717.492078:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789135717.493815:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789135717.493827:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789135717.495541:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135717.495547:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135717.495549:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135717.496059:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135717.496062:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135717.496063:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135717.497322:0:6492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789135717.504132:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789135717.747403:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3263 MB/s 00000001:01000000:2.0:1789135717.996922:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3343 MB/s 00000001:01000000:1.0:1789135718.248787:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 629 MB/s 00000001:01000000:2.0:1789135718.511517:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 520 MB/s 00080000:10000000:2.0:1789135718.525431:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1789135718.563795:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:3.0:1789135718.570837:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135718.573310:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789135718.574308:0:6492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789135718.574369:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789135718.574571:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789135718.574604:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789135718.577027:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135718.577191:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789135718.577197:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789135718.582288:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789135718.582301:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789135718.582799:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789135718.582806:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789135718.583695:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789135718.583720:0:6492:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.131@tcp' 00000020:01000004:0.0:1789135718.583722:0:6492:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789135718.583777:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.131@tcp (typ=mgc) 00000020:00000080:0.0:1789135718.583799:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.131@tcp (00000000cf50de62) 00000020:00000080:0.0:1789135718.583815:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789135718.583964:0:6492:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002ab589c0@MGC192.168.201.131@tcp: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789135718.584123:0:6492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.131@tcp-0 is initialized 00000040:01000000:0.0:1789135718.584130:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789135718.584308:0:6511:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789135718.607648:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789135718.609385:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.131@tcp (uuid 44af6ea5-156e-4935-ba38-1972bb1ada25) 00000020:00000080:2.0:1789135718.609418:0:6492:0:(genops.c:1385:class_connect()) connect: client 44af6ea5-156e-4935-ba38-1972bb1ada25, cookie 0x559c8745c6de24cf 00000100:00080000:2.0:1789135718.609431:0:6492:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135718.609437:0:6492:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import 000000002ab589c0 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789135718.609471:0:6492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000025da8667 x1876044666634368/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135718.609496:0:6492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS 00000020:01000004:2.0:1789135718.609516:0:6492:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789135718.609522:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789135718.609557:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003db93f8c) 00000020:00000080:2.0:1789135718.609571:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789135718.615735:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025da8667 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44af6ea5-156e-4935-ba38-1972bb1ada25:3637:1876044666634368:0@lo:250: 00000100:00100000:0.0:1789135718.615897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.616014:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666634368 00000100:00100000:0.0:1789135718.616023:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666634368 00000100:00100000:0.0:1789135718.616055:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135718.616061:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b41b6995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1876044666634368:12345-0@lo:250: 00010000:00080000:0.0:1789135718.616088:0:6508:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 44af6ea5-156e-4935-ba38-1972bb1ada25@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1789135718.616118:0:6508:0:(genops.c:1385:class_connect()) connect: client 44af6ea5-156e-4935-ba38-1972bb1ada25, cookie 0x559c8745c6de24dd 00000100:00080000:0.0:1789135718.616274:0:6508:0:(import.c:65:import_set_state_nolock()) 000000005bcc0d83 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135718.616325:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b41b6995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:3637:x1876044666634368:12345-0@lo:250: Request processed in 262us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135718.616332:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135718.616374:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789135718.616382:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1789135718.616389:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789135718.616395:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789135718.616397:0:3637:0:(import.c:65:import_set_state_nolock()) 000000002ab589c0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789135718.616400:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789135718.616407:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789135718.616412:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025da8667 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44af6ea5-156e-4935-ba38-1972bb1ada25:3637:1876044666634368:0@lo:250: 00000100:00100000:0.0:1789135718.630277:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135718.630550:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789135718.630557:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789135718.642302:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789135718.642318:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789135718.642808:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789135718.642815:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789135718.645398:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135718.645586:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789135718.645592:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789135718.650721:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789135718.650737:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789135718.687510:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135718.688939:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789135718.688958:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789135718.690205:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789135718.690216:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789135718.690890:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135718.691051:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135718.691055:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789135718.691727:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135718.691734:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789135718.692591:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135718.692752:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135718.692757:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789135718.693811:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135718.693820:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789135718.694581:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135718.694758:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789135718.694764:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789135718.696383:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789135718.696394:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789135718.725049:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789135718.725241:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789135718.725247:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789135718.728445:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789135718.728460:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789135718.733716:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789135718.734273:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789135718.742151:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789135718.742329:0:6492:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789135718.742335:0:6492:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789135718.742441:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789135718.742693:0:6492:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789135718.742699:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789135718.742701:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135718.742703:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135718.742704:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135718.742705:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135718.742707:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135718.742708:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135718.742710:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135718.742711:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135718.742713:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135718.742715:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135718.742716:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135718.742718:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789135718.742721:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135718.742723:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135718.742724:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135718.742725:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135718.742726:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135718.742728:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135718.742729:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135718.742730:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135718.742731:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135718.742733:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135718.742734:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135718.742735:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135718.742763:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789135718.742779:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002610dedc pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634496:0@lo:253: 00000100:00100000:2.0:1789135718.743073:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135718.743192:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a1622f2 going to sleep for 11 seconds 00000100:00100000:3.0:1789135718.744814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666634496 00000100:00100000:3.0:1789135718.744827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666634496 00000100:00100000:3.0:1789135718.745066:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135718.745075:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a320d147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6492:x1876044666634496:12345-0@lo:253: 20000000:01000000:3.0:1789135718.745133:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789135718.745136:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789135718.746196:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789135718.746380:0:6510:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789135718.746952:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135718.748938:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789135718.749348:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789135718.749354:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789135718.749360:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789135718.749363:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789135718.749377:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789135718.756013:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135718.757081:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789135718.757108:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789135718.757138:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789135718.757156:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789135718.758009:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789135718.758114:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789135718.758123:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789135718.758136:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789135718.758150:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789135718.758164:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789135718.758248:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789135718.758336:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789135718.758353:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789135718.758384:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789135718.758390:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789135718.758398:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135718.758810:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789135718.758820:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789135718.758836:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789135718.758850:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789135718.758974:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789135718.758984:0:6510:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789135718.759013:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789135718.759347:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789135718.759369:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789135718.759384:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789135718.759399:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789135718.759408:0:6510:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789135718.759432:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789135718.759439:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789135718.759452:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789135718.759468:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789135718.759819:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789135718.759843:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789135718.762376:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789135718.765590:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789135718.766104:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789135718.766134:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.131@tcp for mdt 20000000:01000000:2.0:1789135718.766137:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:2.0:1789135718.766155:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789135718.766161:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789135718.766201:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789135718.766208:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:2.0:1789135718.766221:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789135718.766229:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789135718.766243:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789135718.766258:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789135718.766287:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789135718.766291:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789135718.766295:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789135718.766339:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789135718.766342:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789135718.768514:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789135718.768923:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789135718.768949:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789135718.768971:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1789135718.768984:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789135718.768986:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789135718.769723:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789135718.770032:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789135718.770054:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789135718.770067:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789135718.770078:0:6510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135718.770080:0:6510:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789135718.770086:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789135718.770089:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789135718.770094:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789135718.770101:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789135718.770426:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789135718.770710:0:6510:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789135718.786353:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789135718.786395:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789135718.786414:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789135718.786437:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789135718.786457:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786475:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786631:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786653:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786659:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786665:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786672:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bb0d1c17 already unused, calling callback (000000007c73147a) 00010000:00010000:1.0:1789135718.786675:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786683:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786697:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786704:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.786709:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb0d1c17/0x559c8745c6de24e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789135718.786731:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789135718.802718:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a320d147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6492:x1876044666634496:12345-0@lo:253: Request processed in 57636us (59637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.802749:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135718.803334:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002610dedc pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634496:0@lo:253: 10000000:01000000:2.0:1789135718.803353:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789135718.803356:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789135718.803358:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789135718.803359:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135718.803360:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789135718.803361:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135718.803378:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135718.803380:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789135718.803381:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789135718.803383:0:6492:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789135718.803384:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135718.803386:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789135718.803618:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000045165197 from lustre-MDT0000 10000000:01000000:3.0:1789135718.803654:0:6492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789135718.803657:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789135718.803662:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a7efa18000 10000000:01000000:3.0:1789135718.803666:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135718.803673:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a7efa18000 from 1 10000000:01000000:3.0:1789135718.803675:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789135718.803713:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.803729:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.803740:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.803759:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634624:0@lo:101: 00000100:00100000:3.0:1789135718.803969:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.804060:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a19cd96 going to sleep for 11 seconds 00000100:00100000:0.0:1789135718.804137:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666634624 00000100:00100000:0.0:1789135718.804144:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666634624 00000100:00100000:0.0:1789135718.804290:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135718.804300:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032a4db8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6492:x1876044666634624:12345-0@lo:101: 00010000:00010000:0.0:1789135718.804313:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135718.804329:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de24eb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.804353:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de24eb expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.804363:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de24eb expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.804371:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089b8808b, rc 0) 00000100:00100000:0.0:1789135718.804413:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032a4db8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+6:6492:x1876044666634624:12345-0@lo:101: Request processed in 116us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135718.804420:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135718.804494:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634624:0@lo:101: 00010000:00010000:3.0:1789135718.804511:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.804519:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.804586:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634752:0@lo:501: 00000100:00100000:3.0:1789135718.804612:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.804874:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a19cd96 going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.805189:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666634752 00000100:00100000:2.0:1789135718.805194:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666634752 00000100:00100000:2.0:1789135718.805221:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789135718.805227:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d6b02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:6492:x1876044666634752:12345-0@lo:501: 00000100:00100000:2.0:1789135718.805315:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d6b02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:6492:x1876044666634752:12345-0@lo:501: Request processed in 88us (702us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789135718.805323:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135718.805764:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634752:0@lo:501: 10000000:01000000:3.0:1789135718.805800:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789135718.805826:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.805834:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.805883:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7d26b4800 10000000:01000000:3.0:1789135718.805888:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789135718.805893:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a7d26b4800 10000000:01000000:3.0:1789135718.805896:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789135718.805899:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a7d26b4800 from 1 10000000:01000000:3.0:1789135718.805901:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789135718.805924:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.805931:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.805940:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.805953:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634880:0@lo:101: 00000100:00100000:3.0:1789135718.805982:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.806006:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a19cd96 going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.806136:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666634880 00000100:00100000:2.0:1789135718.806141:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666634880 00000100:00100000:2.0:1789135718.806162:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135718.806233:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000983d8c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:6492:x1876044666634880:12345-0@lo:101: 00010000:00010000:2.0:1789135718.806242:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135718.806253:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c9bdf8c/0x559c8745c6de2500 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de24f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.806270:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c9bdf8c/0x559c8745c6de2500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de24f9 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.806278:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c9bdf8c/0x559c8745c6de2500 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de24f9 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.806286:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c9bdf8c, rc 0) 00000100:00100000:2.0:1789135718.806312:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000983d8c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:6492:x1876044666634880:12345-0@lo:101: Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.806318:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135718.806392:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666634880:0@lo:101: 00010000:00010000:3.0:1789135718.806403:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.806409:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.806420:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789135718.806432:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.806447:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000b5d3c6e7/0x559c8745c6de24f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.806453:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789135718.806456:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135718.806460:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a7d26b4800 10000000:01000000:3.0:1789135718.806462:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789135718.806464:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789135718.806466:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789135718.806478:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.806608:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.806617:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.806630:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635008:0@lo:101: 00000100:00100000:3.0:1789135718.806655:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.806674:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a19cd96 going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.806722:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635008 00000100:00100000:2.0:1789135718.806727:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635008 00000100:00100000:2.0:1789135718.806744:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135718.806749:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001885a693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:6492:x1876044666635008:12345-0@lo:101: 00010000:00010000:2.0:1789135718.806757:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135718.806764:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2507 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.806776:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2507 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.806783:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2507 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135718.806789:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000463d0f59, rc 0) 00000100:00100000:2.0:1789135718.806902:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001885a693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+8:6492:x1876044666635008:12345-0@lo:101: Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.806909:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135718.807063:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635008:0@lo:101: 00010000:00010000:3.0:1789135718.807073:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.807081:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.807147:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635136:0@lo:501: 00000100:00100000:3.0:1789135718.807184:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.807208:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a19cd96 going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.807248:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635136 00000100:00100000:2.0:1789135718.807252:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635136 00000100:00100000:2.0:1789135718.807269:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135718.807274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fa47c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+8:6492:x1876044666635136:12345-0@lo:501: 00000100:00100000:2.0:1789135718.807377:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fa47c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6492:x1876044666635136:12345-0@lo:501: Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.807384:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789135718.807633:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635136:0@lo:501: 00000100:00100000:3.0:1789135718.807663:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635264:0@lo:503: 00000100:00100000:3.0:1789135718.807706:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.807727:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 000000003a19cd96 going to sleep for 11 seconds 00000100:00100000:0.0:1789135718.807824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635264 00000100:00100000:0.0:1789135718.807831:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635264 00000100:00100000:0.0:1789135718.807879:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135718.807887:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fc69a90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6492:x1876044666635264:12345-0@lo:503: 00000100:00100000:0.0:1789135718.807984:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fc69a90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6492:x1876044666635264:12345-0@lo:503: Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135718.807992:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789135718.808178:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635264:0@lo:503: 00000100:00100000:3.0:1789135718.808886:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6537:1876044666635392:0@lo:502: 00000100:00100000:3.0:1789135718.808940:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.808967:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000184528b6 going to sleep for 11 seconds 00000100:00100000:0.0:1789135718.809080:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635392 00000100:00100000:0.0:1789135718.809085:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635392 00000100:00100000:0.0:1789135718.809121:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135718.809130:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053bb1671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6537:x1876044666635392:12345-0@lo:502: 00000100:00100000:0.0:1789135718.809238:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053bb1671 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6537:x1876044666635392:12345-0@lo:502: Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135718.809246:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135718.809421:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6537:1876044666635392:0@lo:502: 00000020:01000000:3.0:1789135718.809448:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135718.809460:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135718.809462:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135718.809466:0:6537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789135718.809470:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135718.809632:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000099499663) 00000020:00000080:3.0:1789135718.809654:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789135718.809660:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789135718.809754:0:6537:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789135718.809762:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de251c 00000020:00000080:3.0:1789135718.810075:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789135718.810080:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135718.810084:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135718.810091:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789135718.810095:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135718.810099:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135718.810101:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789135718.810103:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135718.810109:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004488785a) 00000020:00000080:3.0:1789135718.810119:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789135718.810123:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789135718.810125:0:6537:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789135718.810127:0:6537:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789135718.810132:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789135718.810207:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045165197 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789135718.810220:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003a5c5ed2) 00000020:00000080:3.0:1789135718.810227:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789135718.810314:0:6537:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789135718.810321:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de2531 00000020:00000080:3.0:1789135718.810417:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789135718.810423:0:6537:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789135718.810427:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x559c8745c6de2538 00080000:01000000:3.0:1789135718.810432:0:6537:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789135718.810436:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de253f 00080000:10000000:3.0:1789135718.811292:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789135718.811444:0:6537:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789135718.816734:0:6537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789135718.884060:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789135718.885145:0:6537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789135718.886718:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789135718.887028:0:6537:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789135718.889688:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ccb5f064) 00000020:00000080:0.0:1789135718.889709:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789135718.889773:0:6537:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789135718.889779:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de254d 00000020:00000080:1.0:1789135718.895789:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789135718.897231:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789135718.899064:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789135718.900600:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789135718.904338:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789135718.907984:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789135718.915072:0:6537:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789135718.917422:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x559c8745c6de2554 00000020:00000080:1.0:1789135718.918125:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789135718.918136:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135718.918194:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135718.918198:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789135718.918203:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135718.918207:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135718.918208:0:6537:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135718.918218:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135718.918220:0:6537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789135718.918223:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135718.918225:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135718.918227:0:6537:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789135718.918229:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135718.918233:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135718.918235:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789135718.918240:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789135718.918298:0:6537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789135718.918355:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002610dedc pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6537:1876044666635520:0@lo:502: 00000100:00100000:2.0:1789135718.918433:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135718.918506:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 000000006af738e0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.918739:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635520 00000100:00100000:1.0:1789135718.918747:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635520 00000100:00100000:1.0:1789135718.918796:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135718.918815:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000953949c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6537:x1876044666635520:12345-0@lo:502: 00000100:00100000:1.0:1789135718.919015:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000953949c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6537:x1876044666635520:12345-0@lo:502: Request processed in 202us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.919023:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135718.919555:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002610dedc pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6537:1876044666635520:0@lo:502: 00000020:01000000:3.0:1789135718.919597:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135718.919604:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135718.919607:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789135718.919610:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789135718.919849:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789135718.919963:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789135718.920030:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.920042:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135718.920063:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d26b4800 from 1 10000000:01000000:0.0:1789135718.920065:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135718.920096:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.920103:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.920111:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135718.920128:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5aacb92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635648:0@lo:101: 00000100:00100000:0.0:1789135718.920175:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.920214:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1daf7d going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.920307:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635648 00000100:00100000:1.0:1789135718.920313:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635648 00000100:00100000:1.0:1789135718.920354:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789135718.920362:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025659a30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+9:6492:x1876044666635648:12345-0@lo:101: 00010000:00010000:1.0:1789135718.920373:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135718.920387:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de255b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.920410:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de255b expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.920419:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de255b expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.920429:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a6fb1d3, rc 0) 00000100:00100000:1.0:1789135718.920485:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025659a30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+10:6492:x1876044666635648:12345-0@lo:101: Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.920492:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135718.920580:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5aacb92 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635648:0@lo:101: 00010000:00010000:3.0:1789135718.920594:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.920608:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.921170:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635776:0@lo:256: 00000100:00100000:3.0:1789135718.921213:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.921238:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbc21d02 going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.921439:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635776 00000100:00100000:1.0:1789135718.921451:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635776 00000100:00100000:1.0:1789135718.921487:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789135718.921501:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc2d9fa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+10:6492:x1876044666635776:12345-0@lo:256: 20000000:01000000:1.0:1789135718.921518:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789135718.921524:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789135718.921602:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc2d9fa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+10:6492:x1876044666635776:12345-0@lo:256: Request processed in 109us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.921609:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135718.921723:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635776:0@lo:256: 10000000:01000000:3.0:1789135718.922264:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789135718.922606:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.922617:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135718.922625:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 1 10000000:01000000:3.0:1789135718.922627:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135718.922657:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.922662:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.922668:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.922679:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635904:0@lo:101: 00000100:00100000:3.0:1789135718.922710:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.922759:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbc21d02 going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.922764:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666635904 00000100:00100000:1.0:1789135718.922768:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666635904 00000100:00100000:3.0:1789135718.922920:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135718.922929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000568f679d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+10:6492:x1876044666635904:12345-0@lo:101: 00010000:00010000:3.0:1789135718.922940:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135718.922953:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2569 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.922973:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2569 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.922984:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2569 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.922991:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000335b8403, rc 0) 00000100:00100000:3.0:1789135718.923034:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000568f679d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666635904:12345-0@lo:101: Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.923040:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135718.923073:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666635904:0@lo:101: 00010000:00010000:0.0:1789135718.923085:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.923093:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135718.923147:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636032:0@lo:501: 00000100:00100000:0.0:1789135718.923175:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.923204:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000abb7f0dc going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.923258:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636032 00000100:00100000:1.0:1789135718.923439:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636032 00000100:00100000:1.0:1789135718.923470:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789135718.923477:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2c4e8c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666636032:12345-0@lo:501: 00000100:00100000:1.0:1789135718.925136:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2c4e8c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666636032:12345-0@lo:501: Request processed in 1655us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.925149:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135718.925638:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636032:0@lo:501: 00000100:00100000:0.0:1789135718.925688:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636160:0@lo:503: 00000100:00100000:0.0:1789135718.925756:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.925798:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000abb7f0dc going to sleep for 11 seconds 00000100:00100000:3.0:1789135718.926451:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636160 00000100:00100000:3.0:1789135718.926457:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636160 00000100:00100000:3.0:1789135718.926506:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135718.926514:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002da9ebca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666636160:12345-0@lo:503: 00000040:00080000:3.0:1789135718.926559:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135718.926625:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002da9ebca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666636160:12345-0@lo:503: Request processed in 113us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.926632:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135718.926652:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636160:0@lo:503: 00000040:00080000:2.0:1789135718.927774:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1789135718.928373:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1789135718.928394:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135718.928412:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.928424:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135718.928472:0:6492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789135718.928475:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7d26b4800 10000000:01000000:0.0:1789135718.928477:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7d26b4800 10000000:01000000:0.0:1789135718.928481:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789135718.928486:0:6492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7d26b4800 from 1 10000000:01000000:0.0:1789135718.928488:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135718.928615:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.928623:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.928632:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135718.928650:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636288:0@lo:101: 00000100:00100000:0.0:1789135718.928702:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.928772:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6944c79 going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.928996:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636288 00000100:00100000:1.0:1789135718.929003:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636288 00000100:00100000:1.0:1789135718.929068:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135718.929075:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000248c1ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666636288:12345-0@lo:101: 00010000:00010000:1.0:1789135718.929086:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135718.929097:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2577 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.929118:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2577 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.929127:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2577 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.929141:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b7f4c85, rc 0) 00000100:00100000:1.0:1789135718.929181:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000248c1ab6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6492:x1876044666636288:12345-0@lo:101: Request processed in 107us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.929188:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789135718.929268:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636288:0@lo:101: 00010000:00010000:0.0:1789135718.929280:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.929288:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135718.929345:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636416:0@lo:501: 00000100:00100000:0.0:1789135718.929369:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.929459:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6944c79 going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.929542:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636416 00000100:00100000:2.0:1789135718.929547:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636416 00000100:00100000:2.0:1789135718.929577:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789135718.929583:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000305e5433 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6492:x1876044666636416:12345-0@lo:501: 00000100:00100000:2.0:1789135718.929688:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000305e5433 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6492:x1876044666636416:12345-0@lo:501: Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.929695:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135718.929829:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636416:0@lo:501: 00000100:00100000:0.0:1789135718.929885:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636544:0@lo:503: 00000100:00100000:0.0:1789135718.929919:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.929930:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6944c79 going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.930051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636544 00000100:00100000:2.0:1789135718.930055:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636544 00000100:00100000:2.0:1789135718.930070:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135718.930075:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094a2a258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6492:x1876044666636544:12345-0@lo:503: 00000100:00100000:2.0:1789135718.930146:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094a2a258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6492:x1876044666636544:12345-0@lo:503: Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.930153:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789135718.930226:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666636544:0@lo:503: 00000100:00100000:0.0:1789135718.930542:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6542:1876044666636672:0@lo:502: 00000100:00100000:0.0:1789135718.930584:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.930611:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1daf7d going to sleep for 11 seconds 00000100:00100000:2.0:1789135718.930706:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636672 00000100:00100000:2.0:1789135718.930715:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636672 00000100:00100000:2.0:1789135718.930732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789135718.930737:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ba8d418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6542:x1876044666636672:12345-0@lo:502: 00000100:00100000:2.0:1789135718.930812:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ba8d418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6542:x1876044666636672:12345-0@lo:502: Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135718.930819:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135718.930977:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6542:1876044666636672:0@lo:502: 00000020:01000004:0.0:1789135718.931034:0:6542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789135718.931051:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c6999633) 00000020:00000080:0.0:1789135718.931069:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789135718.931152:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000045165197 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789135718.931156:0:6542:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000045165197 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789135718.931158:0:6542:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000045165197 4 00010000:00080000:0.0:1789135718.931185:0:6542:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ee938f65@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789135718.933163:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789135718.933356:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789135718.933394:0:6542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789135718.933405:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x559c8745c6de258c 00000100:00080000:0.0:1789135718.933414:0:6542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789135718.933419:0:6542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ee938f65 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789135718.933450:0:6542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000641ece00 x1876044666636800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135718.935833:0:6542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789135718.935976:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666636800:0@lo:38: 00000100:00100000:0.0:1789135718.936075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135718.936613:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636800 00000100:00100000:1.0:1789135718.936624:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636800 00000100:00100000:1.0:1789135718.936664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135718.936671:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc2426e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666636800:12345-0@lo:38: 00000100:00100000:1.0:1789135718.936737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc2426e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666636800:12345-0@lo:38: Request processed in 66us (664us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789135718.936744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135718.936917:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135718.936925:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000ee938f65 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789135718.936929:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789135718.936932:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666636800:0@lo:38: 00000100:00100000:1.0:1789135718.940751:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6542:1876044666636928:0@lo:502: 00000100:00100000:1.0:1789135718.941017:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135718.941074:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:3.0:1789135718.941136:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666636928 00000100:00100000:3.0:1789135718.941143:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666636928 00000100:00100000:3.0:1789135718.941192:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135718.941201:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000749b57b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6542:x1876044666636928:12345-0@lo:502: 00000100:00100000:3.0:1789135718.941335:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000749b57b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6542:x1876044666636928:12345-0@lo:502: Request processed in 135us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135718.941344:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789135718.941622:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:6542:1876044666636928:0@lo:502: 00000040:00080000:1.0:1789135718.941654:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789135718.943322:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789135718.943355:0:6492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135718.943410:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.943423:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135718.943477:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135718.943479:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135718.943481:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135718.943482:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135718.943483:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135718.943484:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135718.943486:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135718.943487:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135718.943488:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135718.943490:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135718.943491:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135718.943492:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135718.943507:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789135718.943510:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135718.943511:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135718.943512:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135718.943513:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135718.943514:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135718.943515:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135718.943516:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135718.943517:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135718.943518:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135718.943519:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135718.943520:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135718.943526:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135718.943550:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789135718.943564:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666637056:0@lo:253: 00000100:00100000:3.0:1789135718.943646:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.943691:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d48bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.943820:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637056 00000100:00100000:1.0:1789135718.943827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637056 00000100:00100000:1.0:1789135718.943904:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135718.943912:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ca036ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6492:x1876044666637056:12345-0@lo:253: 20000000:01000000:1.0:1789135718.943940:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789135718.943954:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789135718.949804:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789135718.949820:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789135718.949979:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789135718.949984:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789135718.950004:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.950018:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de255b expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.950024:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.950055:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de255b expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.950066:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de255b expref: 12 pid: 6510 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135718.950077:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bd2545e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666637184:0@lo:104: 00000100:00100000:3.0:1789135718.950131:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135718.950178:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9bae0b9 going to sleep for 11 seconds 00000100:00100000:1.0:1789135718.950245:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637184 00000100:00100000:1.0:1789135718.950259:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637184 00000100:00100000:1.0:1789135718.950312:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135718.950321:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000696e58d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666637184:12345-0@lo:104: 00010000:00010000:1.0:1789135718.950335:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135718.950392:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135718.950398:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000696e58d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666637184:12345-0@lo:104: Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.950405:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789135718.950411:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135718.950416:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.950424:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad943bb5 already unused, calling callback (00000000b40e24c4) 10000000:00010000:0.0:1789135718.950427:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.950434:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135718.950441:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135718.950458:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135718.950542:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.950549:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789135718.950551:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bd2545e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666637184:0@lo:104: 00010000:00010000:3.0:1789135718.950579:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.950585:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.950591:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000ad943bb5/0x559c8745c6de255b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2562 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.950606:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135718.950608:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135718.950609:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135718.950645:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135718.950654:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666637312:0@lo:103: 00000100:00100000:3.0:1789135718.950689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135718.950930:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637312 00000100:00100000:0.0:1789135718.950935:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637312 00010000:00010000:0.0:1789135718.950955:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de255b expref: 13 pid: 6510 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135718.950978:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135718.950984:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bd2545e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:3638:x1876044666637312:12345-0@lo:103: 00010000:00010000:0.0:1789135718.950996:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135718.951000:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de255b expref: 13 pid: 6510 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951009:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de255b expref: 13 pid: 6510 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951022:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de255b expref: 13 pid: 6510 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951042:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951048:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135718.951059:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001076507s 00010000:00010000:0.0:1789135718.951063:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951069:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951074:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951079:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951083:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005684428e already unused, calling callback (000000007c73147a) 00010000:00010000:0.0:1789135718.951086:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951092:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951111:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135718.951121:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135718.951133:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.951139:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135718.951145:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005684428e/0x559c8745c6de2593 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135718.951173:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bd2545e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3638:x1876044666637312:12345-0@lo:103: Request processed in 181us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135718.951181:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135718.951293:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000641ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666637312:0@lo:103: 00000100:00100000:1.0:1789135718.951700:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ca036ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6492:x1876044666637056:12345-0@lo:253: Request processed in 7787us (8052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135718.951710:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789135718.951774:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:6492:1876044666637056:0@lo:253: 10000000:01000000:3.0:1789135718.951785:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789135718.951788:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135718.951790:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789135718.951791:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135718.951792:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135718.951794:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135718.951795:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135718.951796:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135718.951798:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789135718.951799:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135718.951811:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135718.951813:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135718.951814:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789135718.951828:0:6492:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789135718.957392:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789135718.957552:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789135718.957803:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789135718.957992:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789135718.958191:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789135718.958357:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789135718.959062:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789135718.959178:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789135718.959441:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789135718.959660:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789135718.960037:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789135718.960310:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789135718.963388:0:6492:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789135718.995705:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789135718.995827:0:6547:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789135718.995831:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789135718.996153:0:6548:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789135718.998580:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789135718.998703:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789135718.999627:0:6492:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789135718.999640:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789135718.999791:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135719.004970:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789135719.005547:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789135719.005592:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789135719.005885:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789135719.006134:0:6492:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789135719.006841:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789135719.007057:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789135719.007221:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789135719.007372:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789135719.007506:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789135719.013317:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789135719.017410:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789135719.017589:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789135719.017723:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789135719.019711:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789135719.020102:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789135719.020302:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789135719.020432:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789135719.020583:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789135719.020738:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789135719.020904:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789135719.021205:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789135719.021376:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789135719.021512:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000040:00080000:2.0:1789135719.024055:0:6548:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:3.0:1789135719.029645:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789135719.037509:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789135719.037725:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789135719.037902:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789135719.038005:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789135719.038132:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789135719.038272:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789135719.038381:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789135719.039882:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789135719.040133:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789135719.040314:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789135719.040463:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789135719.040604:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789135719.040792:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789135719.050453:0:6548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789135719.050546:0:6548:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1789135719.050551:0:6548:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1789135719.052447:0:6492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789135719.052498:0:6492:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1d41c2f988 00100000:10000000:2.0:1789135719.052506:0:6492:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789135719.053435:0:6492:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789135719.053449:0:6492:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789135719.053468:0:6492:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789135719.053532:0:6492:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789135719.054684:0:6492:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135719.056433:0:6492:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789135719.592017:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135720.617465:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135721.641588:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135722.665195:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135723.690827:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135723.982454:0:6793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789135724.392259:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789135724.392269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789135724.392289:0:37:0:(import.c:65:import_set_state_nolock()) 00000000ee938f65 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789135724.392302:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ee938f65 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789135724.392328:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf65a0e1 x1876044666637568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789135724.392403:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060fabb7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666637440:0@lo:400: 00000100:00100000:2.0:1789135724.392493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135724.392597:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637440 00000100:00100000:0.0:1789135724.392606:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637440 00000100:00100000:1.0:1789135724.392636:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf65a0e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666637568:0@lo:38: 00000100:00100000:0.0:1789135724.392663:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135724.392672:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b71b4552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:3640:x1876044666637440:12345-0@lo:400: 00000100:00100000:1.0:1789135724.392726:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135724.396713:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060fabb7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666637440:0@lo:400: 00000100:00100000:2.0:1789135724.396790:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637568 00000100:00100000:2.0:1789135724.396799:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637568 00000100:00100000:2.0:1789135724.396879:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135724.396885:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ce2f3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666637568:12345-0@lo:38: 00010000:00080000:2.0:1789135724.396915:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1789135724.396954:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x559c8745c6de259a 00000004:00100000:2.0:1789135724.397010:0:6517:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789135724.397144:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000e9d59c56 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135724.397149:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b71b4552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:3640:x1876044666637440:12345-0@lo:400: Request processed in 4474us (4651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135724.397161:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789135724.398711:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ce2f3e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876044666637568:12345-0@lo:38: Request processed in 1818us (5980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135724.398723:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789135724.407671:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf65a0e1 x1876044666637568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789135724.407698:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789135724.407707:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789135724.407714:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789135724.407717:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000ee938f65 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789135724.407724:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf65a0e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666637568:0@lo:38: 00010000:00010000:1.0:1789135724.711996:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789135724.887562:0:6845:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789135724.888210:0:6845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789135725.737923:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135726.761840:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789135726.952009:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789135726.952019:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d26b4800 from 3 10000000:01000000:2.0:1789135726.952024:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789135726.952075:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135726.952087:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135726.952099:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135726.952123:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084c81551 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666637696:0@lo:101: 00000100:00100000:2.0:1789135726.952192:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135726.952260:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb0aff36 going to sleep for 11 seconds 00000100:00100000:1.0:1789135726.952335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637696 00000100:00100000:1.0:1789135726.952343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637696 00000100:00100000:1.0:1789135726.952405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135726.952416:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de356e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+11:6513:x1876044666637696:12345-0@lo:101: 00010000:00010000:1.0:1789135726.952463:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135726.952479:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de25a1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135726.952509:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135726.952519:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135726.952529:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001ebe25b7, rc 0) 00000100:00100000:1.0:1789135726.952577:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de356e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6513:x1876044666637696:12345-0@lo:101: Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135726.952584:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789135726.952892:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084c81551 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666637696:0@lo:101: 00010000:00010000:0.0:1789135726.952906:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135726.952914:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135726.952975:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5aacb92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666637824:0@lo:256: 00000100:00100000:0.0:1789135726.953006:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135726.953024:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dc6fab0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135726.953093:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637824 00000100:00100000:1.0:1789135726.953098:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637824 00000100:00100000:1.0:1789135726.953125:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135726.953131:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb34d0b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6513:x1876044666637824:12345-0@lo:256: 20000000:01000000:1.0:1789135726.953146:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789135726.953164:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789135726.953167:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789135726.953254:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb34d0b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:6513:x1876044666637824:12345-0@lo:256: Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135726.953260:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789135726.953289:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5aacb92 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666637824:0@lo:256: 10000000:01000000:1.0:1789135726.953335:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135726.953342:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135726.953350:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1789135727.777756:0:6946:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135727.778841:0:6946:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789135727.784204:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135728.808028:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135729.517185:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e97d8a07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666638080:0@lo:400: 00000100:00100000:1.0:1789135729.517258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135729.518890:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666637952:0@lo:400: 00000100:00100000:3.0:1789135729.518953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135729.520912:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638080 00000100:00100000:1.0:1789135729.520926:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638080 00000100:00100000:1.0:1789135729.520983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135729.520991:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076c5b33a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666638080:12345-0@lo:400: 00000100:00100000:1.0:1789135729.521079:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076c5b33a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666638080:12345-0@lo:400: Request processed in 89us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135729.521098:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135729.521126:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666637952 00000100:00100000:1.0:1789135729.521130:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666637952 00000100:00100000:1.0:1789135729.521153:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135729.521158:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004fbf7f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3641:x1876044666637952:12345-0@lo:400: 00000100:00100000:1.0:1789135729.521193:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004fbf7f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3641:x1876044666637952:12345-0@lo:400: Request processed in 35us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135729.521199:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789135729.521248:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e97d8a07 x1876044666638080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135729.521261:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e97d8a07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666638080:0@lo:400: 00000100:00100000:3.0:1789135729.523494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666637952:0@lo:400: 00010000:00010000:0.0:1789135729.835038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135730.856246:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135731.880963:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135732.919415:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135733.930610:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135734.632890:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135734.632927:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666638208:0@lo:400: 00000100:00100000:0.0:1789135734.633069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135734.633155:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638208 00000100:00100000:0.0:1789135734.633164:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638208 00000100:00100000:0.0:1789135734.633216:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135734.633224:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003b1fef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3638:x1876044666638208:12345-0@lo:400: 00000100:00100000:0.0:1789135734.633272:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003b1fef7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3638:x1876044666638208:12345-0@lo:400: Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135734.633279:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135734.633338:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666638208:0@lo:400: 00000100:00100000:2.0:1789135734.633451:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d229cdc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666638336:0@lo:400: 00000100:00100000:2.0:1789135734.633488:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135734.634071:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638336 00000100:00100000:0.0:1789135734.634078:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638336 00000100:00100000:0.0:1789135734.634115:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135734.634121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077cfc08f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666638336:12345-0@lo:400: 00000100:00100000:0.0:1789135734.634170:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077cfc08f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666638336:12345-0@lo:400: Request processed in 50us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135734.634177:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789135734.634315:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d229cdc1 x1876044666638336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135734.634344:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d229cdc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666638336:0@lo:400: 00010000:00010000:3.0:1789135734.953269:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135735.976074:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135737.002881:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789135737.653608:0:7445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789135737.653613:0:7445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789135737.653614:0:7445:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789135737.653752:0:7445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008cf95ac7 00000020:01000004:3.0:1789135737.653821:0:7445:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1789135737.653834:0:7445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789135737.653849:0:7445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000d6a72300) 00000020:00000080:3.0:1789135737.653907:0:7445:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789135737.720459:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789135737.722434:0:7445:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1789135737.736972:0:7445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789135737.737407:0:7445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789135737.737418:0:7445:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789135737.737430:0:7445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de25b6 00000020:01000004:3.0:1789135737.737437:0:7445:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789135737.737458:0:7445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789135737.737531:0:7445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789135737.737546:0:7445:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789135737.737578:0:7445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789135737.737582:0:7445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789135737.755453:0:7445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789135737.755574:0:7445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1789135737.755578:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789135737.755580:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789135737.755581:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135737.755583:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135737.755584:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135737.755585:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135737.755586:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135737.755588:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135737.755589:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135737.755590:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135737.755592:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789135737.755596:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1789135737.755598:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135737.755599:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789135737.755601:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135737.755602:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135737.755603:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135737.755604:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135737.755605:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135737.755606:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135737.755607:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135737.755608:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135737.755609:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789135737.755646:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789135737.755664:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666638464:0@lo:253: 00000100:00100000:3.0:1789135737.755729:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135737.755879:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038ca14b7 going to sleep for 11 seconds 00000100:00100000:0.0:1789135737.756072:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638464 00000100:00100000:0.0:1789135737.756079:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638464 00000100:00100000:0.0:1789135737.756124:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135737.756132:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acd0409d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+12:7445:x1876044666638464:12345-0@lo:253: 20000000:01000000:0.0:1789135737.756166:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789135737.756171:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1789135737.756175:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1789135737.756178:0:6510:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1789135737.756212:0:6510:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1789135737.756634:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135737.756779:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789135737.756795:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789135737.756813:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789135737.757123:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789135737.757138:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789135737.757196:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1789135737.757205:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1789135737.757217:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1789135737.757222:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1789135737.757248:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1789135737.757254:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1789135737.757268:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789135737.757386:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789135737.757578:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1789135737.757588:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:0.0:1789135737.757601:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1789135737.757606:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789135737.757617:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1789135737.757622:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:0.0:1789135737.757633:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1789135737.757638:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789135737.757650:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789135737.757665:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1789135737.757674:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789135737.757753:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1789135737.757763:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1789135737.757777:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1789135737.757792:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1789135737.757808:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1789135737.757813:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1789135737.758383:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1789135737.758416:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1789135737.758423:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1789135737.758564:0:6510:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789135737.758574:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789135737.759982:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789135737.760342:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789135737.760374:0:6510:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.131@tcp for mdt 20000000:01000000:1.0:1789135737.760377:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135737.760393:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789135737.760399:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789135737.760411:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789135737.760416:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135737.760429:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789135737.760438:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789135737.760451:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789135737.760481:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789135737.760544:0:6510:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789135737.760554:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789135737.761018:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789135737.761215:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789135737.761244:0:6510:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.131@tcp for mdt 20000000:01000000:1.0:1789135737.761246:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135737.761263:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789135737.761268:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135737.761280:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789135737.761286:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135737.761302:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789135737.761308:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135737.761321:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789135737.761335:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789135737.761356:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789135737.761360:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789135737.761365:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789135737.761429:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789135737.761431:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789135737.770160:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789135737.770221:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789135737.770284:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789135737.771140:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789135737.771170:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789135737.771187:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789135737.771200:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789135737.771203:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789135737.771393:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789135737.771411:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789135737.771426:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789135737.771504:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789135737.771523:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789135737.771547:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789135737.771556:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789135737.771557:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789135737.771681:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789135737.771696:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789135737.771708:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789135737.771761:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789135737.771779:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789135737.771794:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789135737.771807:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789135737.771809:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789135737.771815:0:6510:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789135737.771821:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789135737.771973:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1789135737.772001:0:6510:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789135737.786253:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789135737.786966:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.786995:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de24eb expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.787080:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2507 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.787088:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2577 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.787094:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.787137:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2577 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.787152:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2577 expref: 12 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.787166:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1876044666638592:0@lo:104: 00000100:00100000:1.0:1789135737.787243:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135737.787351:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2507 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.787359:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2507 expref: 12 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135737.787367:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c841f44f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1876044666638720:0@lo:104: 00000100:00100000:1.0:1789135737.787391:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135737.788352:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638592 00000100:00100000:3.0:1789135737.788361:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638592 00000100:00100000:0.0:1789135737.788429:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638720 00000100:00100000:0.0:1789135737.788433:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638720 00000100:00100000:0.0:1789135737.788540:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135737.788551:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f96b77fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6510:x1876044666638592:12345-0@lo:104: 00010000:00010000:0.0:1789135737.788567:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.788631:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135737.788637:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f96b77fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6510:x1876044666638592:12345-0@lo:104: Request processed in 90us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.788721:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135737.788741:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135737.788748:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045e0e25d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6510:x1876044666638720:12345-0@lo:104: 00010000:00010000:0.0:1789135737.788756:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.788800:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789135737.788805:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045e0e25d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6510:x1876044666638720:12345-0@lo:104: Request processed in 60us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.788812:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789135737.788897:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de24eb expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.788907:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de24eb expref: 12 pid: 6509 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135737.788918:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e77595b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1876044666638848:0@lo:104: 00000100:00100000:0.0:1789135737.788951:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135737.788971:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638848 00000100:00100000:0.0:1789135737.788974:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638848 00000100:00100000:0.0:1789135737.788991:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135737.789018:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f49bdc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6510:x1876044666638848:12345-0@lo:104: 00010000:00010000:0.0:1789135737.789026:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.789058:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789135737.789062:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f49bdc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6510:x1876044666638848:12345-0@lo:104: Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.789069:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135737.789087:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035ab06ae going to sleep for 11 seconds 00000100:00100000:0.0:1789135737.789108:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1876044666638592:0@lo:104: 00000100:00100000:0.0:1789135737.789117:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c841f44f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1876044666638720:0@lo:104: 00000100:00100000:0.0:1789135737.789125:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e77595b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1876044666638848:0@lo:104: 00010000:00010000:0.0:1789135737.789150:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789413:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789135737.789419:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789427:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000964b3f08 already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135737.789430:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789438:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135737.789444:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135737.789449:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135737.789562:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789570:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135737.789590:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789596:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de2577 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de257e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789610:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135737.789612:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789618:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047718f6e already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135737.789620:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789633:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135737.789639:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135737.789723:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135737.789737:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789743:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135737.789757:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789763:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 0000000047718f6e/0x559c8745c6de2507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de250e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789772:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135737.789774:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789780:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a9bf77e already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135737.789781:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789787:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135737.789792:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135737.789803:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135737.789815:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789909:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135737.789915:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789921:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 000000000a9bf77e/0x559c8745c6de24eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de24f2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.789933:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135737.789935:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135737.789936:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135737.789949:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c841f44f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666638976:0@lo:103: 00000100:00100000:1.0:1789135737.789981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135737.790138:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666639104:0@lo:103: 00000100:00100000:1.0:1789135737.790163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135737.790217:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135737.790223:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002f695cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666639232:0@lo:103: 00000100:00100000:1.0:1789135737.790286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135737.790390:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135737.794776:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666638976 00000100:00100000:0.0:1789135737.794796:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666638976 00010000:00010000:0.0:1789135737.794880:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2577 expref: 13 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135737.794908:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639104 00000100:00100000:0.0:1789135737.794911:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639104 00010000:00010000:0.0:1789135737.794923:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2507 expref: 14 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135737.794934:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639232 00000100:00100000:0.0:1789135737.794937:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639232 00010000:00010000:0.0:1789135737.794945:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de24eb expref: 15 pid: 6509 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135737.794980:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135737.794987:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb5d6c5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3641:x1876044666638976:12345-0@lo:103: 00010000:00010000:0.0:1789135737.795197:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135737.795204:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2577 expref: 15 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795218:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2577 expref: 15 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795250:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b7f4c85/0x559c8745c6de257e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2577 expref: 15 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795342:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135737.795420:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb5d6c5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:3641:x1876044666638976:12345-0@lo:103: Request processed in 433us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.795428:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135737.795447:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135737.795454:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020447599 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:3638:x1876044666639104:12345-0@lo:103: 00010000:00010000:0.0:1789135737.795557:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135737.795562:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2507 expref: 13 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795570:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2507 expref: 13 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795580:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000463d0f59/0x559c8745c6de250e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2507 expref: 13 pid: 6508 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795599:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135737.795638:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020447599 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3638:x1876044666639104:12345-0@lo:103: Request processed in 185us (5474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.795658:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135737.795672:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135737.795678:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e97d8a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:3638:x1876044666639232:12345-0@lo:103: 00010000:00010000:0.0:1789135737.795686:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135737.795689:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de24eb expref: 11 pid: 6509 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795697:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de24eb expref: 11 pid: 6509 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795707:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089b8808b/0x559c8745c6de24f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de24eb expref: 11 pid: 6509 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795719:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795728:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795744:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795751:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795757:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795781:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795787:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003fee86da already unused, calling callback (000000007c73147a) 00010000:00010000:0.0:1789135737.795790:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795798:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795814:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795836:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135737.795887:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e97d8a07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+10:3638:x1876044666639232:12345-0@lo:103: Request processed in 210us (5601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.795894:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789135737.795937:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795945:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.795951:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003fee86da/0x559c8745c6de25bd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789135737.795969:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789135737.797446:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c841f44f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666638976:0@lo:103: 00000100:00100000:0.0:1789135737.799029:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002f695cf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666639232:0@lo:103: 00000100:00100000:0.0:1789135737.799047:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666639104:0@lo:103: 00000100:00100000:0.0:1789135737.799953:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acd0409d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+9:7445:x1876044666638464:12345-0@lo:253: Request processed in 43817us (44220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.799967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789135737.800185:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666638464:0@lo:253: 10000000:01000000:3.0:1789135737.800199:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789135737.800203:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135737.800204:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789135737.800205:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135737.800207:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1789135737.800208:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135737.800209:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135737.800211:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789135737.800212:0:7445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789135737.800214:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135737.800215:0:7445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789135737.800246:0:7445:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008cf95ac7 from lustre-MDT0001 10000000:01000000:3.0:1789135737.800287:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789135737.800290:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789135737.800297:0:7445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a7efa18000 local copy 10000000:01000000:3.0:1789135737.800300:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789135737.800338:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.800348:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.800357:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135737.800376:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639360:0@lo:101: 00000100:00100000:3.0:1789135737.800418:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135737.800652:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed68b1a5 going to sleep for 11 seconds 00000100:00100000:0.0:1789135737.800986:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639360 00000100:00100000:0.0:1789135737.800994:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639360 00000100:00100000:0.0:1789135737.801080:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135737.801090:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1f72b19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+9:7445:x1876044666639360:12345-0@lo:101: 00010000:00010000:0.0:1789135737.801104:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135737.801119:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000415d3d57/0x559c8745c6de25cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de25c4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.801143:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000415d3d57/0x559c8745c6de25cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de25c4 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.801153:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000415d3d57/0x559c8745c6de25cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25c4 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.801161:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000415d3d57, rc 0) 00000100:00100000:0.0:1789135737.801211:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1f72b19 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+10:7445:x1876044666639360:12345-0@lo:101: Request processed in 123us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.801218:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789135737.804048:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639360:0@lo:101: 00010000:00010000:2.0:1789135737.804077:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.804090:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.804245:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639488:0@lo:501: 00000100:00100000:2.0:1789135737.804320:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.804369:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c90946b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789135737.805495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639488 00000100:00100000:3.0:1789135737.805505:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639488 00000100:00100000:3.0:1789135737.805564:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135737.805572:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e57a5a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+10:7445:x1876044666639488:12345-0@lo:501: 00000100:00100000:3.0:1789135737.805685:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e57a5a26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+10:7445:x1876044666639488:12345-0@lo:501: Request processed in 114us (1366us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135737.805693:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135737.805884:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639488:0@lo:501: 10000000:01000000:2.0:1789135737.805905:0:7445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789135737.805928:0:7445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789135737.805934:0:7445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.805944:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.805950:0:7445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.805974:0:7445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789135737.806015:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7fa5f7000 10000000:01000000:2.0:1789135737.806020:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789135737.806025:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a7efa18000 10000000:01000000:2.0:1789135737.806028:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789135737.806031:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a7efa18000 from 1 10000000:01000000:2.0:1789135737.806034:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789135737.806060:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.806067:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.806076:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.806094:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639616:0@lo:101: 00000100:00100000:2.0:1789135737.806130:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.806169:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed8267d going to sleep for 11 seconds 00010000:00010000:1.0:1789135737.806240:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135737.806246:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.806253:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063a1fe34 already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135737.806256:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.806271:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135737.806277:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135737.806282:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135737.806310:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.806317:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135737.806340:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.806346:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 0000000063a1fe34/0x559c8745c6de25c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de25cb expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135737.806362:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135737.806364:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135737.806365:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135737.806447:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639616 00000100:00100000:0.0:1789135737.806453:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639616 00000100:00100000:0.0:1789135737.806495:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135737.806503:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e506a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+10:7445:x1876044666639616:12345-0@lo:101: 00010000:00010000:0.0:1789135737.806513:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135737.806525:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003cb87d39/0x559c8745c6de25d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de25d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.806558:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cb87d39/0x559c8745c6de25d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de25d2 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.806568:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003cb87d39/0x559c8745c6de25d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25d2 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.806576:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003cb87d39, rc 0) 00000100:00100000:0.0:1789135737.806610:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e506a98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+11:7445:x1876044666639616:12345-0@lo:101: Request processed in 108us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.806617:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135737.806712:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666639744:0@lo:103: 00000100:00100000:2.0:1789135737.806743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.806913:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639616:0@lo:101: 00010000:00010000:2.0:1789135737.806928:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.806935:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135737.806952:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789135737.806964:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.806979:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000a3297b4d/0x559c8745c6de25d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135737.806988:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a7fa5f7000 10000000:01000000:2.0:1789135737.806992:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789135737.806995:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a7fa5f7000 from 1 10000000:01000000:2.0:1789135737.806997:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789135737.807013:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.807019:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.807025:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.807036:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639872:0@lo:101: 00000100:00100000:2.0:1789135737.807061:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.807080:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed8267d going to sleep for 11 seconds 00000100:00100000:3.0:1789135737.809004:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639872 00000100:00100000:3.0:1789135737.809020:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639872 00000100:00100000:3.0:1789135737.809102:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135737.809112:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a909d9f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+11:7445:x1876044666639872:12345-0@lo:101: 00010000:00010000:3.0:1789135737.809129:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135737.809147:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005684428e/0x559c8745c6de25e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de25e0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.809175:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005684428e/0x559c8745c6de25e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de25e0 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.809186:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005684428e/0x559c8745c6de25e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25e0 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.809194:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005684428e, rc 0) 00000100:00100000:3.0:1789135737.809271:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a909d9f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:7445:x1876044666639872:12345-0@lo:101: Request processed in 160us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135737.809278:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789135737.809788:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666639872:0@lo:101: 00010000:00010000:2.0:1789135737.809807:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.809817:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135737.809835:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789135737.809874:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.809898:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 000000002947bd4b/0x559c8745c6de25e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135737.809905:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789135737.809909:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135737.809916:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a7fa5f7000 10000000:01000000:2.0:1789135737.809918:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789135737.809921:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789135737.809923:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789135737.809952:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.809958:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.809966:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.809983:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640000:0@lo:101: 00000100:00100000:2.0:1789135737.810020:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.810053:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed8267d going to sleep for 11 seconds 00000100:00100000:2.0:1789135737.810072:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640000 00000100:00100000:2.0:1789135737.810077:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640000 00000100:00100000:2.0:1789135737.810111:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789135737.810116:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c17e2e69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+12:7445:x1876044666640000:12345-0@lo:101: 00010000:00010000:2.0:1789135737.810124:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135737.810132:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006680a93e/0x559c8745c6de25f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de25ee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.810158:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006680a93e/0x559c8745c6de25f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de25ee expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.810165:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006680a93e/0x559c8745c6de25f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25ee expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.810171:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006680a93e, rc 0) 00000100:00100000:2.0:1789135737.810200:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c17e2e69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640000:12345-0@lo:101: Request processed in 84us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.810206:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789135737.810245:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640000:0@lo:101: 00010000:00010000:2.0:1789135737.810254:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135737.810260:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135737.810348:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640128:0@lo:501: 00000100:00100000:2.0:1789135737.810374:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.810383:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed8267d going to sleep for 11 seconds 00000100:00100000:2.0:1789135737.810402:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640128 00000100:00100000:2.0:1789135737.810405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640128 00000100:00100000:2.0:1789135737.810421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789135737.810426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025c90685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640128:12345-0@lo:501: 00000100:00100000:2.0:1789135737.810524:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025c90685 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640128:12345-0@lo:501: Request processed in 98us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.810531:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789135737.810563:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640128:0@lo:501: 00000100:00100000:2.0:1789135737.810609:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640256:0@lo:503: 00000100:00100000:2.0:1789135737.810648:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.810657:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed8267d going to sleep for 11 seconds 00000100:00100000:2.0:1789135737.810675:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640256 00000100:00100000:2.0:1789135737.810678:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640256 00000100:00100000:2.0:1789135737.810694:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789135737.810699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f7e8457 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640256:12345-0@lo:503: 00000100:00100000:2.0:1789135737.810772:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f7e8457 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640256:12345-0@lo:503: Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.810779:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789135737.810813:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640256:0@lo:503: 00000040:00080000:2.0:1789135737.814691:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135737.814822:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640384:0@lo:502: 00000100:00100000:2.0:1789135737.814925:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.814945:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd1daf7d going to sleep for 11 seconds 00000100:00100000:2.0:1789135737.814987:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640384 00000100:00100000:2.0:1789135737.814994:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640384 00000100:00100000:2.0:1789135737.815030:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135737.815038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025414e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640384:12345-0@lo:502: 00000100:00100000:2.0:1789135737.815167:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025414e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640384:12345-0@lo:502: Request processed in 130us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.815175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135737.815222:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640384:0@lo:502: 00000040:00080000:2.0:1789135737.815467:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789135737.815495:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789135737.815516:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789135737.815528:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789135737.815540:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789135737.815550:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789135737.815561:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789135737.815573:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789135737.815584:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789135737.815596:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789135737.815608:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789135737.815620:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789135737.815632:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789135737.815657:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789135737.815671:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789135737.815683:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789135737.815694:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789135737.815705:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789135737.815717:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789135737.815729:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789135737.815740:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789135737.815751:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789135737.815764:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789135737.815786:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640512:0@lo:502: 00000100:00100000:2.0:1789135737.815821:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.815830:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097ac13e6 going to sleep for 11 seconds 00000100:00100000:2.0:1789135737.815879:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640512 00000100:00100000:2.0:1789135737.815884:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640512 00000100:00100000:2.0:1789135737.815904:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135737.815909:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc1fbe2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640512:12345-0@lo:502: 00000100:00100000:2.0:1789135737.815979:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc1fbe2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666640512:12345-0@lo:502: Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.815986:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135737.816025:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000019e7b32 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666640512:0@lo:502: 00000040:00080000:2.0:1789135737.816058:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789135737.816065:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000100:00100000:0.0:1789135737.821357:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666639744 00000100:00100000:0.0:1789135737.821374:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666639744 00000100:00100000:0.0:1789135737.821455:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135737.821465:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d229cdc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:3640:x1876044666639744:12345-0@lo:103: 00010000:00010000:0.0:1789135737.821485:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135737.821504:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000415d3d57/0x559c8745c6de25cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de25c4 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.821522:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135737.821610:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d229cdc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3640:x1876044666639744:12345-0@lo:103: Request processed in 147us (14867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.821618:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135737.821778:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666639744:0@lo:103: 00000020:01000000:3.0:1789135737.822832:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135737.822902:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135737.822905:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789135737.822911:0:7457:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789135737.822915:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135737.822945:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a1d2761c) 00000020:00000080:3.0:1789135737.822967:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789135737.822974:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789135737.823056:0:7457:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789135737.823064:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de2603 00000020:00000080:3.0:1789135737.823340:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789135737.823346:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135737.823350:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135737.823351:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789135737.823354:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135737.823357:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135737.823358:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789135737.823362:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135737.823369:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000f8e67adf) 00000020:00000080:3.0:1789135737.823379:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1789135737.823383:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789135737.823385:0:7457:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789135737.823388:0:7457:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789135737.823393:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789135737.823447:0:7457:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008cf95ac7 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789135737.823460:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000037de3a88) 00000020:00000080:3.0:1789135737.823468:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1789135737.823540:0:7457:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789135737.823546:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de2618 00000020:00000080:3.0:1789135737.823654:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789135737.823660:0:7457:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789135737.823664:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x559c8745c6de261f 00080000:01000000:3.0:1789135737.823670:0:7457:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789135737.823673:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de2626 00080000:10000000:3.0:1789135737.824104:0:7457:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789135737.824258:0:7457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1789135737.969794:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789135737.970138:0:7457:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789135737.975443:0:7457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789135737.977437:0:7457:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789135737.992971:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789135737.992986:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135737.992994:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135737.992997:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789135737.993000:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135737.993007:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135737.993008:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789135737.993011:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789135737.993015:0:7457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:00000080:3.0:1789135737.993044:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135737.993057:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000086d03939) 00000020:00000080:3.0:1789135737.993079:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789135737.993084:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789135737.993180:0:7457:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789135737.993186:0:7457:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789135737.993193:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de2634 00010000:00080000:3.0:1789135737.993240:0:7457:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b3c8d370@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789135737.995443:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789135737.996182:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789135737.996199:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789135737.996256:0:7457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789135737.996284:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de263b 00000100:00080000:1.0:1789135737.996295:0:7457:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135737.996301:0:7457:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000b3c8d370 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789135737.996341:0:7457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000017900d26 x1876044666640640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135737.996371:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789135737.996427:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135737.996431:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135737.996433:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789135737.996435:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789135737.996438:0:7457:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789135737.996439:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789135737.996441:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789135737.996442:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789135737.996444:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135737.996445:0:7457:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789135737.996447:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135737.996450:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135737.996452:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789135737.996455:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789135737.996485:0:7457:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789135737.996497:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135737.996500:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135737.996501:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789135737.996503:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135737.996505:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135737.996506:0:7457:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135737.996509:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135737.996510:0:7457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789135737.996538:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135737.996541:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135737.996543:0:7457:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135737.996546:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1789135737.997187:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e77595b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666640768:0@lo:400: 00000100:00100000:0.0:1789135737.997265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135737.997329:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000029d779ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666640896:0@lo:400: 00000100:00100000:0.0:1789135737.997356:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135737.997399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640896 00000100:00100000:0.0:1789135737.997406:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640896 00000100:00100000:0.0:1789135737.997450:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135737.997459:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e084793f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666640896:12345-0@lo:400: 00000100:00100000:2.0:1789135737.997667:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666640640:0@lo:38: 00000100:00100000:2.0:1789135737.997744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135737.997775:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640768 00000100:00100000:2.0:1789135737.997779:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640768 00000100:00100000:2.0:1789135737.997802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135737.997807:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000550a079b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3641:x1876044666640768:12345-0@lo:400: 00000100:00100000:2.0:1789135737.997844:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000550a079b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+12:3641:x1876044666640768:12345-0@lo:400: Request processed in 36us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135737.997851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135737.997896:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666640640 00000100:00100000:2.0:1789135737.997899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666640640 00000100:00100000:2.0:1789135737.997915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135737.997919:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000019e7b32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666640640:12345-0@lo:38: 00010000:00080000:2.0:1789135737.997937:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1789135737.997966:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de2642 00000004:00100000:2.0:1789135737.997979:0:6520:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789135737.997984:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789135737.998063:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e77595b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666640768:0@lo:400: 00000100:00100000:0.0:1789135737.998160:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e084793f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666640896:12345-0@lo:400: Request processed in 703us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.998167:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789135737.998252:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000029d779ca x1876044666640896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135737.998264:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000029d779ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666640896:0@lo:400: 00000020:01000000:3.0:1789135737.998596:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789135737.998632:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789135737.998683:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.998694:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 0000000021abfc9d/0x559c8745c6de25ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135737.998720:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa5f7000 from 1 10000000:01000000:3.0:1789135737.998723:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789135737.998754:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.998762:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.998771:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135737.998787:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641024:0@lo:101: 00000100:00100000:3.0:1789135737.998900:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135737.998935:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a5c67fc going to sleep for 11 seconds 00000100:00100000:0.0:1789135737.999043:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641024 00000100:00100000:0.0:1789135737.999049:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641024 00000100:00100000:0.0:1789135737.999082:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789135737.999087:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a703c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+12:7445:x1876044666641024:12345-0@lo:101: 00010000:00010000:0.0:1789135737.999096:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135737.999106:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2649 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.999124:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2649 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.999134:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2649 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135737.999142:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000415d3d57, rc 0) 00000100:00100000:0.0:1789135737.999167:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a703c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666641024:12345-0@lo:101: Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135737.999173:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789135737.999247:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641024:0@lo:101: 00010000:00010000:3.0:1789135737.999258:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135737.999266:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135738.000580:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641152:0@lo:256: 00000100:00100000:3.0:1789135738.000639:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135738.000734:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a5c67fc going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.000791:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641152 00000100:00100000:0.0:1789135738.000798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641152 00000100:00100000:0.0:1789135738.001079:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135738.001088:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e2c35ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666641152:12345-0@lo:256: 20000000:01000000:0.0:1789135738.001118:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789135738.001131:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789135738.001134:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789135738.001216:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e2c35ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666641152:12345-0@lo:256: Request processed in 130us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135738.001234:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789135738.001305:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad734ca1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641152:0@lo:256: 10000000:01000000:1.0:1789135738.001928:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135738.001943:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.001953:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135738.001968:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 1 10000000:01000000:1.0:1789135738.001971:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135738.001994:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.002001:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.002010:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.002023:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641280:0@lo:101: 00000100:00100000:1.0:1789135738.002054:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.002434:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47c867b going to sleep for 11 seconds 00000100:00100000:3.0:1789135738.002511:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641280 00000100:00100000:3.0:1789135738.002517:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641280 00000100:00100000:3.0:1789135738.002556:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789135738.002562:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a92c6980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:7445:x1876044666641280:12345-0@lo:101: 00010000:00010000:3.0:1789135738.002580:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135738.002592:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2657 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135738.002615:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2657 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135738.002625:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2657 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135738.002633:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000063a1fe34, rc 0) 00000100:00100000:3.0:1789135738.002676:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a92c6980 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:7445:x1876044666641280:12345-0@lo:101: Request processed in 115us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.002682:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789135738.003251:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641280:0@lo:101: 00010000:00010000:1.0:1789135738.003268:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.003276:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.003394:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641408:0@lo:501: 00000100:00100000:1.0:1789135738.003428:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.003441:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47c867b going to sleep for 11 seconds 00000100:00100000:3.0:1789135738.003635:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641408 00000100:00100000:3.0:1789135738.003641:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641408 00000100:00100000:3.0:1789135738.003667:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789135738.003672:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067ca99e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:7445:x1876044666641408:12345-0@lo:501: 00000100:00100000:3.0:1789135738.003777:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067ca99e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:7445:x1876044666641408:12345-0@lo:501: Request processed in 104us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.003783:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135738.003923:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641408:0@lo:501: 00000100:00100000:1.0:1789135738.003953:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641536:0@lo:503: 00000100:00100000:1.0:1789135738.004003:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.004076:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47c867b going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.004129:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641536 00000100:00100000:0.0:1789135738.004134:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641536 00000100:00100000:2.0:1789135738.004243:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135738.004259:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d044294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:7445:x1876044666641536:12345-0@lo:503: 00000040:00080000:2.0:1789135738.004304:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135738.004354:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d044294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:7445:x1876044666641536:12345-0@lo:503: Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135738.004360:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135738.004426:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641536:0@lo:503: 00000040:00080000:1.0:1789135738.004681:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135738.004741:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789135738.004815:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135738.006619:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789135738.006876:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789135738.006909:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135738.006925:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.006939:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135738.007037:0:7445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789135738.007041:0:7445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7fa5f7000 10000000:01000000:1.0:1789135738.007044:0:7445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7fa5f7000 10000000:01000000:1.0:1789135738.007047:0:7445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789135738.007053:0:7445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7fa5f7000 from 1 10000000:01000000:1.0:1789135738.007056:0:7445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135738.007089:0:7445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.007097:0:7445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.007107:0:7445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.007127:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641664:0@lo:101: 00000100:00100000:1.0:1789135738.007206:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.007258:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a66b5329 going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.007338:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641664 00000100:00100000:0.0:1789135738.007345:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641664 00000100:00100000:0.0:1789135738.007385:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135738.007393:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a7677f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+14:7445:x1876044666641664:12345-0@lo:101: 00010000:00010000:0.0:1789135738.007405:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135738.007417:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089b8808b/0x559c8745c6de266c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2665 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135738.007440:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089b8808b/0x559c8745c6de266c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2665 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135738.007449:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089b8808b/0x559c8745c6de266c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2665 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135738.007458:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089b8808b, rc 0) 00000100:00100000:0.0:1789135738.007503:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a7677f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666641664:12345-0@lo:101: Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135738.007510:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789135738.007789:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641664:0@lo:101: 00010000:00010000:1.0:1789135738.007803:0:7445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.007812:0:7445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.007922:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641792:0@lo:501: 00000100:00100000:1.0:1789135738.007949:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.007973:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a66b5329 going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.008062:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641792 00000100:00100000:0.0:1789135738.008066:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641792 00000100:00100000:0.0:1789135738.008084:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135738.008094:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000250dc9c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666641792:12345-0@lo:501: 00000100:00100000:0.0:1789135738.008450:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000250dc9c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666641792:12345-0@lo:501: Request processed in 354us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135738.008470:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789135738.009163:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000cd4db836 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135738.009239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000019e7b32 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666640640:12345-0@lo:38: Request processed in 11319us (11495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135738.009250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135738.009411:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135738.009420:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789135738.009428:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789135738.009433:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789135738.009436:0:3637:0:(import.c:65:import_set_state_nolock()) 00000000b3c8d370 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135738.009467:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666640640:0@lo:38: 00000100:00100000:2.0:1789135738.009607:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135738.009619:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666641920:0@lo:41: 00000100:00100000:2.0:1789135738.009653:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135738.009699:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666641920 00000100:00100000:2.0:1789135738.009705:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666641920 00000100:00100000:2.0:1789135738.009735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135738.009742:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021a6e8df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666641920:12345-0@lo:41: 00000004:00000024:2.0:1789135738.009767:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789135738.009804:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021a6e8df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666641920:12345-0@lo:41: Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135738.009811:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135738.009838:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666641920:0@lo:41: 00000100:00100000:1.0:1789135738.010115:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666641792:0@lo:501: 00000100:00100000:1.0:1789135738.010157:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642048:0@lo:503: 00000100:00100000:1.0:1789135738.010201:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.010273:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a66b5329 going to sleep for 11 seconds 00000100:00100000:2.0:1789135738.010311:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642048 00000100:00100000:2.0:1789135738.010315:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642048 00000100:00100000:2.0:1789135738.010380:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789135738.010388:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b7c4241 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642048:12345-0@lo:503: 00000100:00100000:2.0:1789135738.010491:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b7c4241 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642048:12345-0@lo:503: Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135738.010504:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135738.010571:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642048:0@lo:503: 00000040:00080000:1.0:1789135738.010836:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789135738.010923:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642176:0@lo:502: 00000100:00100000:1.0:1789135738.010956:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.011283:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a66b5329 going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.011370:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642176 00000100:00100000:0.0:1789135738.011376:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642176 00000100:00100000:0.0:1789135738.011406:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789135738.011412:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e61ca0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642176:12345-0@lo:502: 00000100:00100000:0.0:1789135738.011521:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e61ca0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642176:12345-0@lo:502: Request processed in 109us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135738.011528:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789135738.011647:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642176:0@lo:502: 00000040:00080000:1.0:1789135738.011845:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789135738.011902:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789135738.011917:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789135738.011930:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789135738.011956:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789135738.011970:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789135738.011983:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789135738.011996:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789135738.012009:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789135738.012022:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789135738.012052:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789135738.012068:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789135738.012083:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789135738.012096:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789135738.012107:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789135738.012119:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789135738.012130:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789135738.012141:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789135738.012151:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789135738.012162:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789135738.012173:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789135738.012183:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789135738.012193:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789135738.012204:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789135738.012215:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789135738.012241:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789135738.012268:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789135738.012284:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789135738.012313:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642304:0@lo:502: 00000100:00100000:1.0:1789135738.012361:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.012384:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a66b5329 going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.012470:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642304 00000100:00100000:0.0:1789135738.012476:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642304 00000100:00100000:0.0:1789135738.012499:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789135738.012505:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000637dee7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642304:12345-0@lo:502: 00000100:00100000:0.0:1789135738.012587:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000637dee7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642304:12345-0@lo:502: Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135738.012593:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789135738.012722:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642304:0@lo:502: 00000040:00080000:1.0:1789135738.012760:0:7445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789135738.012767:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789135738.013267:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789135738.013286:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000bd383405) 00000020:00000080:1.0:1789135738.013306:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789135738.013391:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008cf95ac7 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789135738.013395:0:7463:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008cf95ac7 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789135738.013397:0:7463:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008cf95ac7 3 00010000:00080000:1.0:1789135738.013424:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002cea3750@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1789135738.015642:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789135738.015912:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789135738.015957:0:7463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789135738.015970:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x559c8745c6de267a 00000100:00080000:1.0:1789135738.015982:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135738.015986:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000002cea3750 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789135738.016027:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004fb00159 x1876044666642432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789135738.016065:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666642432:0@lo:38: 00000100:00100000:1.0:1789135738.016152:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.016214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642432 00000100:00100000:1.0:1789135738.016232:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642432 00000100:00100000:1.0:1789135738.016262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135738.016268:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f695cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666642432:12345-0@lo:38: 00010000:00080000:1.0:1789135738.016293:0:6516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1789135738.016330:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x559c8745c6de2681 00000004:00100000:1.0:1789135738.016347:0:6516:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789135738.016377:0:6516:0:(import.c:65:import_set_state_nolock()) 0000000087f57236 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135738.016425:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f695cf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876044666642432:12345-0@lo:38: Request processed in 156us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.016432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789135738.019157:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004fb00159 x1876044666642432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135738.019184:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789135738.019196:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789135738.019206:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789135738.019211:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789135738.019213:0:3637:0:(import.c:65:import_set_state_nolock()) 000000002cea3750 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789135738.019218:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666642432:0@lo:38: 00000100:00080000:2.0:1789135738.019976:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1789135738.020366:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789135738.020437:0:7445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789135738.020481:0:7445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135738.020500:0:7445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135738.020513:0:7445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000075625b9/0x559c8745c6de2665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789135738.020596:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789135738.020600:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789135738.020601:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135738.020602:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135738.020603:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135738.020604:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135738.020607:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135738.020609:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135738.020611:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135738.020612:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135738.020614:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789135738.020619:0:7445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789135738.020623:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135738.020625:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789135738.020626:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135738.020627:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135738.020628:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135738.020630:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135738.020631:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135738.020631:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135738.020633:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135738.020633:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135738.020634:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789135738.020668:0:7445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789135738.020691:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fdf42b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642560:0@lo:253: 00000100:00100000:0.0:1789135738.020780:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.020897:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642560 00000100:00100000:1.0:1789135738.020905:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642560 00000100:00100000:0.0:1789135738.020938:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 0000000012c4852c going to sleep for 11 seconds 00000100:00100000:1.0:1789135738.020944:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789135738.020953:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cfa6cee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642560:12345-0@lo:253: 20000000:01000000:1.0:1789135738.020980:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789135738.020993:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1789135738.021082:0:7465:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00010000:2.0:1789135738.025042:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135738.026102:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789135738.026182:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789135738.026240:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789135738.026608:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cfa6cee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7445:x1876044666642560:12345-0@lo:253: Request processed in 5650us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.026622:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789135738.026733:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fdf42b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:7445:1876044666642560:0@lo:253: 10000000:01000000:0.0:1789135738.026760:0:7445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789135738.026763:0:7445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135738.026765:0:7445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789135738.026766:0:7445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135738.026768:0:7445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135738.026769:0:7445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135738.026770:0:7445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135738.026771:0:7445:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789135738.026773:0:7445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135738.026774:0:7445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135738.026776:0:7445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135738.026777:0:7445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789135738.026796:0:7445:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789135738.028612:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789135738.028622:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00080000:10000000:0.0:1789135738.032551:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789135738.032744:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:1.0:1789135738.032998:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033019:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033026:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2649 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033031:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033082:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2649 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033097:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2649 expref: 14 pid: 6508 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.033112:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666642688:0@lo:104: 00000100:00100000:1.0:1789135738.033178:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135738.033246:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033254:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 14 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.033262:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666642816:0@lo:104: 00000100:00100000:1.0:1789135738.033301:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.033322:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47c867b going to sleep for 11 seconds 00000100:00100000:1.0:1789135738.033367:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642688 00000100:00100000:1.0:1789135738.033374:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642688 00000100:00100000:1.0:1789135738.033410:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642816 00000100:00100000:1.0:1789135738.033413:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642816 00000100:00100000:1.0:1789135738.033426:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135738.033433:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c841f44f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6531:x1876044666642688:12345-0@lo:104: 00010000:00010000:1.0:1789135738.033445:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033509:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135738.033514:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c841f44f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6531:x1876044666642688:12345-0@lo:104: Request processed in 82us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.033527:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135738.033546:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135738.033551:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008626b2b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666642816:12345-0@lo:104: 00010000:00010000:1.0:1789135738.033557:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033602:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135738.033607:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008626b2b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666642816:12345-0@lo:104: Request processed in 57us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.033613:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789135738.033632:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135738.033638:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033645:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d30ef084 already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135738.033648:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033656:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135738.033662:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135738.033666:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135738.033697:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033704:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135738.033730:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033736:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000d30ef084/0x559c8745c6de2649 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2650 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033749:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135738.033751:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033757:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6a3ce05 already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135738.033758:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033764:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135738.033769:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135738.033774:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135738.033786:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033792:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135738.033796:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033801:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000e6a3ce05/0x559c8745c6de25a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de25a8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.033813:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135738.033820:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135738.033822:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135738.033834:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666642944:0@lo:103: 00000100:00100000:1.0:1789135738.033890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.033914:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135738.033920:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031707a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666643072:0@lo:103: 00000100:00100000:1.0:1789135738.033943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.033981:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666642944 00000100:00100000:1.0:1789135738.033986:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666642944 00010000:00010000:1.0:1789135738.034003:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2649 expref: 15 pid: 6508 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.034021:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643072 00000100:00100000:1.0:1789135738.034024:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643072 00010000:00010000:1.0:1789135738.034034:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 16 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.034045:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135738.034051:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056199b67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3640:x1876044666642944:12345-0@lo:103: 00010000:00010000:1.0:1789135738.034059:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135738.034063:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2649 expref: 16 pid: 6508 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034070:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2649 expref: 16 pid: 6508 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034085:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135738.034112:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056199b67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3640:x1876044666642944:12345-0@lo:103: Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.034119:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789135738.034141:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135738.034146:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005acb11b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3640:x1876044666643072:12345-0@lo:103: 00010000:00010000:1.0:1789135738.034154:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135738.034157:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034164:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 15 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034175:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034182:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789135738.034194:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005572973s 00010000:00010000:1.0:1789135738.034198:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034204:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034210:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034216:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034230:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a6fb1d3 already unused, calling callback (000000007c73147a) 00010000:00010000:1.0:1789135738.034234:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034251:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034259:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034268:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135738.034288:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005acb11b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3640:x1876044666643072:12345-0@lo:103: Request processed in 143us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.034294:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789135738.034339:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135738.034366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031707a71 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666643072:0@lo:103: 00000100:00100000:1.0:1789135738.034373:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666642944:0@lo:103: 00010000:00010000:1.0:1789135738.034396:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000415d3d57/0x559c8745c6de2650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2649 expref: 14 pid: 6508 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.034405:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004fb00159 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666642688:0@lo:104: 00010000:00010000:1.0:1789135738.034411:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001ebe25b7/0x559c8745c6de25a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de25a1 expref: 13 pid: 6510 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135738.034418:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000017900d26 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666642816:0@lo:104: 00010000:00010000:1.0:1789135738.034430:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034438:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034453:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135738.034458:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de2688 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789135738.035045:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789135738.035290:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789135738.035996:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789135738.036183:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789135738.037724:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789135738.038412:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789135738.038579:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789135738.038684:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789135738.038840:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789135738.039057:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1789135738.043336:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789135738.044882:0:7468:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789135738.044891:0:7468:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789135738.045040:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1789135738.045102:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1876044666643200:0@lo:700: 00000100:00100000:2.0:1789135738.045190:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135738.045239:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbc54d5e going to sleep for 11 seconds 00000100:00100000:0.0:1789135738.045311:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643200 00000100:00100000:0.0:1789135738.045320:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643200 00000100:00100000:0.0:1789135738.045378:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789135738.045387:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012972219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1876044666643200:12345-0@lo:700: 00000040:01000000:3.0:1789135738.045699:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789135738.046378:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643328:0@lo:1000: 00000100:00100000:1.0:1789135738.046424:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.046478:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072436fde going to sleep for 11 seconds 00000100:00100000:3.0:1789135738.046546:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643328 00000100:00100000:3.0:1789135738.046553:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643328 00000100:00100000:3.0:1789135738.046592:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135738.046599:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031707a71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643328:12345-0@lo:1000: 00000100:00100000:3.0:1789135738.046663:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031707a71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643328:12345-0@lo:1000: Request processed in 65us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.046677:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789135738.046943:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643328:0@lo:1000: 00000040:01000000:1.0:1789135738.046976:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789135738.046999:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643456:0@lo:700: 00000100:00100000:1.0:1789135738.047023:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.047039:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47c867b going to sleep for 11 seconds 00000100:00100000:3.0:1789135738.047146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643456 00000100:00100000:3.0:1789135738.047151:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643456 00000100:00100000:3.0:1789135738.047183:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135738.047190:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056199b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643456:12345-0@lo:700: 00000100:00100000:3.0:1789135738.047241:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056199b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643456:12345-0@lo:700: Request processed in 52us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.047248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:2.0:1789135738.047835:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789135738.048142:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789135738.048626:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643456:0@lo:700: 00000100:00100000:1.0:1789135738.048692:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1876044666643584:0@lo:900: 00000100:00100000:1.0:1789135738.048739:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.048769:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d47c867b going to sleep for 11 seconds 00000100:00100000:3.0:1789135738.048887:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643584 00000100:00100000:3.0:1789135738.048893:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643584 00000100:00100000:3.0:1789135738.048933:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135738.048940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c33484a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1876044666643584:12345-0@lo:900: 00000100:00100000:3.0:1789135738.048994:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c33484a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1876044666643584:12345-0@lo:900: Request processed in 55us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.049002:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789135738.049187:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b2eed160 x1876044666643584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789135754 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135738.049197:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1876044666643584:0@lo:900: 00000100:00100000:1.0:1789135738.049274:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643712:0@lo:1000: 00000100:00100000:1.0:1789135738.049303:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.049327:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a66b5329 going to sleep for 11 seconds 00000004:00000080:2.0:1789135738.049709:0:7445:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789135738.049719:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1789135738.050247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643712 00000100:00100000:3.0:1789135738.050254:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643712 00000100:00100000:3.0:1789135738.050306:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135738.050314:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036e1ae7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643712:12345-0@lo:1000: 00000100:00100000:3.0:1789135738.050393:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036e1ae7b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643712:12345-0@lo:1000: Request processed in 81us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.050406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135738.050717:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643712:0@lo:1000: 00000004:00080000:1.0:1789135738.050786:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d47c867b with version 0 00000020:00100000:1.0:1789135738.050805:0:7470:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789135738.050810:0:7470:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b2eed160 x1876044666643968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789135738.050835:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643968:0@lo:1000: 00000100:00100000:1.0:1789135738.050899:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.050920:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063464ba0 going to sleep for 11 seconds 00000040:00080000:2.0:1789135738.051165:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135738.052188:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789135738.052751:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789135738.052792:0:7445:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789135738.053054:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789135738.058157:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666643968 00000100:00100000:0.0:1789135738.058219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666643968 00000100:00100000:0.0:1789135738.058282:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135738.058290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0f7005 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643968:12345-0@lo:1000: 00080000:10000000:2.0:1789135738.059338:0:7445:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789135738.060278:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789135738.060419:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789135738.060561:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789135738.060712:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789135738.061509:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789135738.061737:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 40000000:02000000:3.0:1789135738.062032:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000001:00080000:1.0:1789135738.065952:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:2.0:1789135738.065974:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000100:00100000:1.0:1789135738.066175:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0f7005 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666643968:12345-0@lo:1000: Request processed in 7882us (15271us total) trans 4294967297 rc 0/0 00100000:10000000:2.0:1789135738.066182:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000100:00100000:1.0:1789135738.066197:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1789135738.066270:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789135738.066275:0:7470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789135738.066292:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666643968:0@lo:1000: 00100000:10000000:2.0:1789135738.066388:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:1.0:1789135738.066388:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666644096:0@lo:1000: 00000100:00100000:1.0:1789135738.066441:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.066491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644096 00000100:00100000:1.0:1789135738.066498:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644096 00000100:00100000:1.0:1789135738.066546:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135738.066556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcd7fa08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666644096:12345-0@lo:1000: 00100000:10000000:2.0:1789135738.066568:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000100:00100000:1.0:1789135738.066650:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcd7fa08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1876044666644096:12345-0@lo:1000: Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135738.066659:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789135738.066708:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072436fde going to sleep for 11 seconds 00000100:00100000:1.0:1789135738.066724:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1876044666644096:0@lo:1000: 00000040:00080000:1.0:1789135738.066743:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1789135738.066745:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000004:00080000:1.0:1789135738.066779:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000d47c867b with version 1 00000004:00080000:1.0:1789135738.066800:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000036f3af85 version 1 rpc_version 1 00000020:00100000:1.0:1789135738.066816:0:7460:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789135738.066824:0:7460:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b2eed160 x1876044666644352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789135738.066839:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1876044666644352:0@lo:1000: 00000100:00100000:1.0:1789135738.066893:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135738.066906:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061ad2330 going to sleep for 11 seconds 00000100:00100000:1.0:1789135738.066919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644352 00000100:00100000:1.0:1789135738.066923:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644352 00100000:10000000:2.0:1789135738.066931:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:1.0:1789135738.066947:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135738.066954:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3436bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1876044666644352:12345-0@lo:1000: 00100000:10000000:2.0:1789135738.067102:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:0.0:1789135738.071529:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789135738.071607:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1789135738.078709:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789135738.079020:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789135738.079162:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789135738.079503:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789135738.079650:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789135738.079790:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789135738.079974:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789135738.080120:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789135738.080262:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789135738.080394:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789135738.080538:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789135738.080673:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789135738.080846:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789135738.081010:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789135738.081163:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789135738.081335:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789135738.081470:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789135738.081607:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789135738.081760:0:7445:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789135738.081994:0:7445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789135738.084769:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012972219 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1876044666643200:12345-0@lo:700: Request processed in 39376us (39572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135738.084790:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789135738.084935:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000be331606 x1876044666643200/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135754 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135738.084951:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1876044666643200:0@lo:700: 40000000:02000000:0.0:1789135738.084967:0:7469:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1789135738.095971:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789135738.096166:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3436bf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7460:x1876044666644352:12345-0@lo:1000: Request processed in 29210us (29270us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789135738.096182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1789135738.096287:0:7460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789135738.096292:0:7460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789135738.096310:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2eed160 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1876044666644352:0@lo:1000: 00000001:00080000:2.0:1789135738.097647:0:7445:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789135738.097688:0:7445:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1d41c37988 00100000:10000000:2.0:1789135738.097697:0:7445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789135738.099373:0:7445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789135738.099411:0:7445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789135738.099434:0:7445:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789135738.099480:0:7445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789135738.100297:0:7445:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135738.100486:0:7445:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1789135738.135051:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135738.146657:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789135738.146747:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789135738.146754:0:7469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789135739.062309:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135740.074506:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135741.105532:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135742.120009:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135742.663250:0:7714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789135743.145140:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135743.343799:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b323e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666644736:0@lo:400: 00000100:00100000:1.0:1789135743.343933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135743.344006:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135743.344013:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6c62d7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666644864:0@lo:400: 00000100:00100000:1.0:1789135743.344042:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135743.344087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644736 00000100:00100000:1.0:1789135743.344107:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644736 00000100:00100000:1.0:1789135743.344168:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135743.344176:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbc06710 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666644736:12345-0@lo:400: 00000100:00100000:1.0:1789135743.344239:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbc06710 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666644736:12345-0@lo:400: Request processed in 64us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135743.344247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135743.344300:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b323e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666644736:0@lo:400: 00000100:00100000:0.0:1789135743.345509:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666644480:0@lo:400: 00000100:00100000:0.0:1789135743.345565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135743.345622:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135743.345629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666644608:0@lo:400: 00000100:00100000:0.0:1789135743.345655:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135743.345692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644864 00000100:00100000:0.0:1789135743.345698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644864 00000100:00100000:0.0:1789135743.345847:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644608 00000100:00100000:0.0:1789135743.345867:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644608 00000100:00100000:0.0:1789135743.345886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135743.345893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064f00e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666644864:12345-0@lo:400: 00000100:00100000:0.0:1789135743.346143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064f00e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666644864:12345-0@lo:400: Request processed in 249us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135743.346150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135743.346168:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135743.346174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029d779ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666644608:12345-0@lo:400: 00000100:00100000:0.0:1789135743.346206:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029d779ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666644608:12345-0@lo:400: Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135743.346212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135743.346236:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644480 00000100:00100000:0.0:1789135743.346239:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644480 00000100:00100000:0.0:1789135743.346263:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789135743.346269:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edb98233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:3638:x1876044666644480:12345-0@lo:400: 00000100:00100000:0.0:1789135743.346306:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edb98233 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:3638:x1876044666644480:12345-0@lo:400: Request processed in 38us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135743.346313:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789135743.347949:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a6c62d7f x1876044666644864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135743.347964:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6c62d7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666644864:0@lo:400: 00000100:00100000:1.0:1789135743.350966:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b323e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666644992:0@lo:41: 00000100:00100000:1.0:1789135743.351065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135743.351146:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ba0bb797 x1876044666644608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135743.351163:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666644608:0@lo:400: 00000100:00100000:1.0:1789135743.351173:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666644480:0@lo:400: 00000100:00100000:1.0:1789135743.351214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666644992 00000100:00100000:1.0:1789135743.351222:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666644992 00000100:00100000:1.0:1789135743.351268:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135743.351276:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6c62d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666644992:12345-0@lo:41: 00000004:00000024:1.0:1789135743.351314:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789135743.351693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6c62d7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666644992:12345-0@lo:41: Request processed in 417us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135743.351701:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789135743.355646:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b323e91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666644992:0@lo:41: 00000020:00000004:2.0:1789135743.598586:0:7766:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789135743.599904:0:7766:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789135744.172223:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135744.872134:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789135744.872163:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa5f7000 from 4 10000000:01000000:1.0:1789135744.872168:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789135744.872222:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.872236:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.872247:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.872270:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645120:0@lo:101: 00000100:00100000:1.0:1789135744.872364:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.872442:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054dc947d going to sleep for 11 seconds 00000100:00100000:0.0:1789135744.872903:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645120 00000100:00100000:0.0:1789135744.872911:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645120 00000100:00100000:0.0:1789135744.872969:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789135744.872977:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000844b2be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+13:6513:x1876044666645120:12345-0@lo:101: 00010000:00010000:0.0:1789135744.872990:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135744.873002:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe88bf1c/0x559c8745c6de2696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de268f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.873022:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe88bf1c/0x559c8745c6de2696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de268f expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.873032:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe88bf1c/0x559c8745c6de2696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de268f expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.873186:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe88bf1c, rc 0) 00000100:00100000:0.0:1789135744.873243:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000844b2be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+14:6513:x1876044666645120:12345-0@lo:101: Request processed in 267us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135744.873251:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789135744.873459:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645120:0@lo:101: 00010000:00010000:1.0:1789135744.873475:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.873484:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.873541:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645248:0@lo:256: 00000100:00100000:1.0:1789135744.873574:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.873610:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054dc947d going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.873677:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645248 00000100:00100000:2.0:1789135744.873682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645248 00000100:00100000:2.0:1789135744.873719:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135744.873725:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000256192b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:6513:x1876044666645248:12345-0@lo:256: 20000000:01000000:2.0:1789135744.873739:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135744.873754:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135744.873757:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789135744.873844:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000256192b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:6513:x1876044666645248:12345-0@lo:256: Request processed in 119us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.873851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789135744.874450:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645248:0@lo:256: 10000000:01000000:1.0:1789135744.874499:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135744.874506:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.874523:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000173a0e3c/0x559c8745c6de268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135744.874534:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135744.874537:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7d26b4800 from 21 10000000:01000000:1.0:1789135744.874539:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135744.874565:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.874572:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.874581:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.874595:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645376:0@lo:101: 00000100:00100000:1.0:1789135744.874629:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.874675:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054dc947d going to sleep for 11 seconds 00000100:00100000:0.0:1789135744.874841:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645376 00000100:00100000:0.0:1789135744.874847:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645376 00000100:00100000:0.0:1789135744.874917:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789135744.874924:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008681d07f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+14:6513:x1876044666645376:12345-0@lo:101: 00010000:00010000:0.0:1789135744.874934:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135744.874951:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048dced51/0x559c8745c6de26a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de269d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.874975:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048dced51/0x559c8745c6de26a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de269d expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.874985:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048dced51/0x559c8745c6de26a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de269d expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.874993:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048dced51, rc 0) 00000100:00100000:0.0:1789135744.875035:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008681d07f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666645376:12345-0@lo:101: Request processed in 111us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135744.875049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135744.875134:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645376:0@lo:101: 00010000:00010000:1.0:1789135744.875147:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.875154:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.875209:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645504:0@lo:501: 00000100:00100000:1.0:1789135744.875236:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.875283:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054dc947d going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.875358:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645504 00000100:00100000:3.0:1789135744.875363:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645504 00000100:00100000:3.0:1789135744.875398:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789135744.875404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000827ca47d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666645504:12345-0@lo:501: 00000100:00100000:3.0:1789135744.875535:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000827ca47d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666645504:12345-0@lo:501: Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.875541:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135744.875764:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645504:0@lo:501: 00000100:00100000:1.0:1789135744.875794:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645632:0@lo:503: 00000100:00100000:1.0:1789135744.875833:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.875888:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054dc947d going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.876140:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645632 00000100:00100000:2.0:1789135744.876145:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645632 00000100:00100000:2.0:1789135744.876182:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135744.876189:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007905423e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666645632:12345-0@lo:503: 00000100:00100000:2.0:1789135744.876280:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007905423e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666645632:12345-0@lo:503: Request processed in 92us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.876287:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789135744.876460:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666645632:0@lo:503: 00000100:00100000:1.0:1789135744.876943:0:7819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7819:1876044666645760:0@lo:502: 00000100:00100000:1.0:1789135744.876983:0:7819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.877016:0:7819:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.877132:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645760 00000100:00100000:2.0:1789135744.877138:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645760 00000100:00100000:2.0:1789135744.877170:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789135744.877176:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c80c4662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7819:x1876044666645760:12345-0@lo:502: 00000100:00100000:2.0:1789135744.877264:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c80c4662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7819:x1876044666645760:12345-0@lo:502: Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.877271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789135744.877454:0:7819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7819:1876044666645760:0@lo:502: 00000100:00100000:1.0:1789135744.877495:0:7819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7819:1876044666645888:0@lo:502: 00000100:00100000:1.0:1789135744.877530:0:7819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.877553:0:7819:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.877608:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666645888 00000100:00100000:3.0:1789135744.877612:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666645888 00000100:00100000:3.0:1789135744.877643:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789135744.877648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f4302dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7819:x1876044666645888:12345-0@lo:502: 00000100:00100000:3.0:1789135744.877736:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f4302dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:7819:x1876044666645888:12345-0@lo:502: Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.877743:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135744.878088:0:7819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7819:1876044666645888:0@lo:502: 00000040:00080000:1.0:1789135744.878122:0:7819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789135744.878358:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789135744.878382:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135744.878390:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.878402:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 000000003fff1fc7/0x559c8745c6de269d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135744.878411:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135744.878414:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d26b4800 from 4 10000000:01000000:0.0:1789135744.878416:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135744.878445:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.878452:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.878461:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135744.878482:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fdf42b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646016:0@lo:101: 00000100:00100000:0.0:1789135744.878516:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.878553:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c94449a going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.878741:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646016 00000100:00100000:2.0:1789135744.878746:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646016 00000100:00100000:2.0:1789135744.878781:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789135744.878788:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9a2fb6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666646016:12345-0@lo:101: 00010000:00010000:2.0:1789135744.878797:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135744.878808:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f822841/0x559c8745c6de26b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de26ab expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.878829:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f822841/0x559c8745c6de26b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de26ab expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.878839:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f822841/0x559c8745c6de26b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26ab expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.878846:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f822841, rc 0) 00000100:00100000:2.0:1789135744.879108:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9a2fb6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666646016:12345-0@lo:101: Request processed in 312us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.879115:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789135744.879464:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fdf42b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646016:0@lo:101: 00010000:00010000:1.0:1789135744.879574:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.879583:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.879636:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646144:0@lo:256: 00000100:00100000:1.0:1789135744.879736:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.879809:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:0.0:1789135744.879850:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646144 00000100:00100000:0.0:1789135744.880042:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646144 00000100:00100000:0.0:1789135744.880118:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135744.880126:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2aaf317 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666646144:12345-0@lo:256: 20000000:01000000:0.0:1789135744.880141:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789135744.880158:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789135744.880162:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789135744.880247:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2aaf317 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666646144:12345-0@lo:256: Request processed in 123us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135744.880253:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789135744.880312:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646144:0@lo:256: 10000000:01000000:1.0:1789135744.880363:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135744.880369:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.880376:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000e5de43e7/0x559c8745c6de26ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135744.880384:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789135744.880386:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789135744.880388:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789135744.880407:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.880413:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.880420:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.880431:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646272:0@lo:101: 00000100:00100000:1.0:1789135744.880455:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.880674:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.880810:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646272 00000100:00100000:2.0:1789135744.880815:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646272 00000100:00100000:2.0:1789135744.880839:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789135744.880844:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffb47207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666646272:12345-0@lo:101: 00010000:00010000:2.0:1789135744.880890:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135744.880903:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000278fb607/0x559c8745c6de26c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de26b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.880922:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000278fb607/0x559c8745c6de26c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.880931:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000278fb607/0x559c8745c6de26c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.880939:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000278fb607, rc 0) 00000100:00100000:2.0:1789135744.880971:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffb47207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666646272:12345-0@lo:101: Request processed in 126us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.880976:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135744.881124:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646272:0@lo:101: 00010000:00010000:1.0:1789135744.881137:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.881145:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135744.881211:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646400:0@lo:501: 00000100:00100000:1.0:1789135744.881240:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.881309:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:0.0:1789135744.881372:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646400 00000100:00100000:0.0:1789135744.881377:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646400 00000100:00100000:3.0:1789135744.881659:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789135744.881668:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000365c528d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666646400:12345-0@lo:501: 00000100:00100000:3.0:1789135744.881784:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000365c528d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666646400:12345-0@lo:501: Request processed in 117us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.881790:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135744.881845:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646400:0@lo:501: 00000100:00100000:1.0:1789135744.881900:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646528:0@lo:503: 00000100:00100000:1.0:1789135744.881941:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135744.882151:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000007bb11e58 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.882178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646528 00000100:00100000:2.0:1789135744.882182:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646528 00000100:00100000:2.0:1789135744.882209:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135744.882214:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000126b4055 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666646528:12345-0@lo:503: 00000100:00100000:2.0:1789135744.882405:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000126b4055 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666646528:12345-0@lo:503: Request processed in 189us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.882412:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135744.882588:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a187e050 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666646528:0@lo:503: 00000100:00100000:3.0:1789135744.883174:0:7820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7820:1876044666646656:0@lo:502: 00000100:00100000:3.0:1789135744.883219:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.883250:0:7820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000014bcfa35 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.883312:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646656 00000100:00100000:2.0:1789135744.883323:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646656 00000100:00100000:2.0:1789135744.883430:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789135744.883438:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b69fbdea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:7820:x1876044666646656:12345-0@lo:502: 00000100:00100000:2.0:1789135744.883708:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b69fbdea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:7820:x1876044666646656:12345-0@lo:502: Request processed in 270us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.883715:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789135744.883796:0:7820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7820:1876044666646656:0@lo:502: 00000020:01000000:3.0:1789135744.883822:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135744.883834:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135744.883836:0:7820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789135744.883841:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789135744.883845:0:7820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:00000080:3.0:1789135744.883964:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135744.883988:0:7820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000005be833ac) 00000020:00000080:3.0:1789135744.884009:0:7820:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789135744.884016:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789135744.884108:0:7820:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789135744.884114:0:7820:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789135744.884121:0:7820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de26ce 00010000:00080000:3.0:1789135744.884150:0:7820:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006ef17264@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789135744.887801:0:7820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789135744.894431:0:7820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135744.894451:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789135744.894498:0:7820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789135744.894524:0:7820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de26d5 00000100:00080000:2.0:1789135744.894536:0:7820:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135744.894542:0:7820:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000006ef17264 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789135744.894580:0:7820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000084c81551 x1876044666646784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135744.894614:0:7820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789135744.894664:0:7820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789135744.895010:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084c81551 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666646784:0@lo:38: 00000100:00100000:0.0:1789135744.895095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.895294:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135744.895305:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666646912:0@lo:400: 00000100:00100000:3.0:1789135744.895365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.895404:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646912 00000100:00100000:3.0:1789135744.895412:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646912 00000100:00100000:3.0:1789135744.895456:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135744.895466:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044cdf91c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666646912:12345-0@lo:400: 00000100:00100000:3.0:1789135744.895525:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044cdf91c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666646912:12345-0@lo:400: Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.895532:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789135744.895578:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000653daca4 x1876044666646912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135744.895593:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666646912:0@lo:400: 00000100:00100000:0.0:1789135744.895835:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf65a0e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666647040:0@lo:400: 00000100:00100000:0.0:1789135744.895894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.895915:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135744.895920:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060fabb7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666647168:0@lo:400: 00000100:00100000:0.0:1789135744.895940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.895964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666646784 00000100:00100000:0.0:1789135744.895967:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666646784 00000100:00100000:0.0:1789135744.895983:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647040 00000100:00100000:0.0:1789135744.895985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647040 00000100:00100000:0.0:1789135744.896003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135744.896016:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e77595b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666646784:12345-0@lo:38: 00010000:00080000:0.0:1789135744.896037:0:6521:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1789135744.896067:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de26dc 00000004:00100000:0.0:1789135744.896083:0:6521:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789135744.896089:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1789135744.896435:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135744.896442:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135744.896444:0:7820:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789135744.896447:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135744.896451:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135744.896453:0:7820:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789135744.896455:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789135744.896457:0:7820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789135744.896492:0:7820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7820:1876044666647296:0@lo:502: 00000100:00100000:3.0:1789135744.896538:0:7820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.896562:0:7820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000328934d2 going to sleep for 11 seconds 00000100:00080000:2.0:1789135744.896870:0:7823:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d0e0fbb5 x1876044666647424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135744.897051:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647296 00000100:00100000:0.0:1789135744.897056:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647296 00000100:00100000:0.0:1789135744.897111:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789135744.897118:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8cbda2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:7820:x1876044666647296:12345-0@lo:502: 00000100:00100000:0.0:1789135744.897240:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8cbda2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:7820:x1876044666647296:12345-0@lo:502: Request processed in 123us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135744.897248:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789135744.897319:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6aa2219 going to sleep for 0 seconds 00000100:00100000:3.0:1789135744.897488:0:7820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:7820:1876044666647296:0@lo:502: 00000020:01000000:3.0:1789135744.897519:0:7820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135744.897525:0:7820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135744.897527:0:7820:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789135744.897531:0:7820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1789135744.897788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647168 00000100:00100000:1.0:1789135744.897794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647168 00000100:00100000:1.0:1789135744.897831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135744.897838:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000438e4e5a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666647168:12345-0@lo:400: 00000020:01000000:0.0:1789135744.897976:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789135744.897998:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789135744.898007:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.898016:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 000000001ebe25b7/0x559c8745c6de26b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135744.898025:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789135744.898028:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a7efa18000 from 1 10000000:01000000:0.0:1789135744.898031:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789135744.898058:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.898066:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135744.898088:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135744.898114:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a36ae629 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666647552:0@lo:101: 00000100:00100000:0.0:1789135744.898159:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.898194:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e6aa76d5 going to sleep for 11 seconds 00000100:00100000:1.0:1789135744.898270:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000438e4e5a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666647168:12345-0@lo:400: Request processed in 433us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.898278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135744.898306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647552 00000100:00100000:1.0:1789135744.898311:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647552 00000100:00100000:1.0:1789135744.898998:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789135744.899009:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009060e094 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666647552:12345-0@lo:101: 00010000:00010000:1.0:1789135744.899021:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135744.899033:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de26ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de26e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.899056:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de26ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.899083:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a6fb1d3/0x559c8745c6de26ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135744.899091:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a6fb1d3, rc 0) 00000100:00100000:1.0:1789135744.899144:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009060e094 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666647552:12345-0@lo:101: Request processed in 137us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135744.899150:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789135744.899512:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a36ae629 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666647552:0@lo:101: 00010000:00010000:2.0:1789135744.899529:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.899538:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135744.899633:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019ea43d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666647680:0@lo:501: 00000100:00100000:2.0:1789135744.899676:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.899708:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021191c8a going to sleep for 11 seconds 00010000:00080000:0.0:1789135744.899780:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000060fabb7b x1876044666647168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135744.899791:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060fabb7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666647168:0@lo:400: 00000100:00100000:3.0:1789135744.900507:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647680 00000100:00100000:3.0:1789135744.900515:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647680 00000100:00100000:3.0:1789135744.900559:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789135744.900566:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b41b6995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666647680:12345-0@lo:501: 00000100:00100000:3.0:1789135744.902560:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b41b6995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666647680:12345-0@lo:501: Request processed in 1985us (2874us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135744.902576:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789135744.902743:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019ea43d8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666647680:0@lo:501: 10000000:01000000:2.0:1789135744.902795:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789135744.902805:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135744.902815:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000964b3f08/0x559c8745c6de26e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789135744.910204:0:6521:0:(import.c:65:import_set_state_nolock()) 000000008d4599e9 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135744.910546:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789135744.910557:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789135744.910565:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789135744.910570:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789135744.910572:0:3637:0:(import.c:65:import_set_state_nolock()) 000000006ef17264 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789135744.910592:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d6aa2219): req@00000000d0e0fbb5 x1876044666647424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135744.910614:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084c81551 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666646784:0@lo:38: 00000100:00100000:0.0:1789135744.910660:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e77595b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666646784:12345-0@lo:38: Request processed in 14447us (15369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135744.910670:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135744.910701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135744.910712:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdb24ac4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666647040:12345-0@lo:400: 00000100:00100000:2.0:1789135744.910902:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.910926:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789135744.910932:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789135744.911046:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6aa2219 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.911065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647424 00000100:00100000:2.0:1789135744.911070:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647424 00000100:00100000:2.0:1789135744.911174:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135744.911181:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019ea43d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666647424:12345-0@lo:1000: 00000100:00100000:3.0:1789135744.911230:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666647808:0@lo:41: 00000100:00100000:2.0:1789135744.911256:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019ea43d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666647424:12345-0@lo:1000: Request processed in 75us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.911258:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.911263:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135744.911284:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647808 00000100:00100000:3.0:1789135744.911287:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647808 00000100:00100000:2.0:1789135744.911289:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0e0fbb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666647424:0@lo:1000: 00000100:00100000:3.0:1789135744.911304:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135744.911308:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000405aaa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666647808:12345-0@lo:41: 00000040:01000000:2.0:1789135744.911323:0:7823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000004:00000024:3.0:1789135744.911335:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789135744.911363:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0e0fbb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666647936:0@lo:1000: 00000100:00100000:3.0:1789135744.911385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000405aaa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666647808:12345-0@lo:41: Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.911390:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.911399:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135744.911399:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c3d1826 going to sleep for 11 seconds 00000100:00100000:2.0:1789135744.911409:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666647936 00000100:00100000:2.0:1789135744.911412:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666647936 00000100:00100000:3.0:1789135744.911426:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666647808:0@lo:41: 00000100:00100000:2.0:1789135744.911436:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789135744.911440:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002610dedc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666647936:12345-0@lo:1000: 00000100:00100000:2.0:1789135744.911548:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002610dedc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666647936:12345-0@lo:1000: Request processed in 107us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.911554:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135744.911719:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0e0fbb5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666647936:0@lo:1000: 00000100:00100000:3.0:1789135744.911758:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648064:0@lo:700: 00000100:00100000:3.0:1789135744.911784:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135744.911807:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060e4cdff going to sleep for 11 seconds 00000100:00100000:0.0:1789135744.911871:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdb24ac4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666647040:12345-0@lo:400: Request processed in 1162us (15976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135744.911880:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135744.912008:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666648064 00000100:00100000:2.0:1789135744.912013:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666648064 00000100:00100000:2.0:1789135744.912045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135744.912051:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a52f06d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666648064:12345-0@lo:700: 00000100:00100000:2.0:1789135744.912109:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a52f06d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666648064:12345-0@lo:700: Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135744.912116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135744.912187:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648064:0@lo:700: 00000100:00100000:1.0:1789135744.912230:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf65a0e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666647040:0@lo:400: 00000100:00100000:0.0:1789135744.912641:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3e469ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648192:0@lo:1000: 00000100:00100000:0.0:1789135744.912665:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.912683:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b85b81f2 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.912700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666648192 00000100:00100000:3.0:1789135744.912704:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666648192 00000100:00100000:3.0:1789135744.912771:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135744.912778:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d07c73d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666648192:12345-0@lo:1000: 00000100:00100000:3.0:1789135744.912838:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d07c73d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666648192:12345-0@lo:1000: Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.912845:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789135744.912895:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3e469ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648192:0@lo:1000: 00000004:00080000:0.0:1789135744.912937:0:7823:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f9287cc3 with version 0 00000020:00100000:0.0:1789135744.912958:0:7823:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789135744.912964:0:7823:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f3e469ad x1876044666648448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135744.912978:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3e469ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648448:0@lo:1000: 00000100:00100000:0.0:1789135744.913000:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.913022:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032023fd6 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.913024:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666648448 00000100:00100000:3.0:1789135744.913028:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666648448 00000100:00100000:3.0:1789135744.913046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789135744.913055:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007942a05f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1876044666648448:12345-0@lo:1000: 00000001:00080000:1.0:1789135744.922742:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789135744.922758:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789135744.923000:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007942a05f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7823:x1876044666648448:12345-0@lo:1000: Request processed in 9940us (9994us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789135744.923015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789135744.923205:0:7823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789135744.923211:0:7823:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789135744.923226:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3e469ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648448:0@lo:1000: 00000100:00100000:0.0:1789135744.923318:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3e469ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648576:0@lo:1000: 00000100:00100000:0.0:1789135744.923371:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135744.923421:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000718e57a2 going to sleep for 11 seconds 00000100:00100000:3.0:1789135744.923819:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666648576 00000100:00100000:3.0:1789135744.923826:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666648576 00000100:00100000:3.0:1789135744.923966:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789135744.923984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a67bf2a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7823:x1876044666648576:12345-0@lo:1000: 00000100:00100000:3.0:1789135744.924055:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a67bf2a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7823:x1876044666648576:12345-0@lo:1000: Request processed in 72us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135744.924062:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135744.924136:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3e469ad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1876044666648576:0@lo:1000: 00000040:00080000:1.0:1789135744.924156:0:7823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789135744.924187:0:7823:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000007bb11e58 with version 1 00000004:00080000:3.0:1789135744.925196:0:7821:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005cb3308f version 1 rpc_version 1 00000020:00100000:3.0:1789135744.925233:0:7821:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789135744.925243:0:7821:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001bd2545e x1876044666648832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135744.925261:0:7821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bd2545e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7821:1876044666648832:0@lo:1000: 00000100:00100000:3.0:1789135744.925308:0:7821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135744.925411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666648832 00000100:00100000:2.0:1789135744.925419:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666648832 00000100:00100000:2.0:1789135744.925461:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135744.925471:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad734ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7821:x1876044666648832:12345-0@lo:1000: 00000100:00100000:3.0:1789135744.926057:0:7821:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dacea254 going to sleep for 11 seconds 00000001:00080000:3.0:1789135744.930684:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789135744.930932:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad734ca1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7821:x1876044666648832:12345-0@lo:1000: Request processed in 5458us (5619us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789135744.930946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1789135744.931113:0:7821:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789135744.931119:0:7821:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789135744.931139:0:7821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bd2545e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7821:1876044666648832:0@lo:1000: 00000040:00080000:1.0:1789135744.931296:0:7823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789135744.931386:0:7823:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789135744.931391:0:7823:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789135745.192222:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135746.222001:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789135746.256519:0:7874:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135746.256750:0:7874:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789135747.244121:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789135747.266742:0:7922:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4131a110 20000000:00000080:3.0:1789135747.266764:0:7922:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7f64a8c00 uarg=0000000000000000 20000000:01000000:3.0:1789135747.266809:0:7922:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789135747.266818:0:7922:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789135747.266823:0:7922:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789135747.267828:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789135747.267934:0:7922:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789135747.282523:0:7922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135747.282791:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789135747.282823:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789135747.282887:0:7922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789135747.282903:0:7922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789135747.282921:0:7922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.282938:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2569 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.282945:0:7922:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2657 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.282952:0:7922:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.282989:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2657 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.283004:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2657 expref: 17 pid: 6508 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135747.283017:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bd2545e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876044666648960:0@lo:104: 00000100:00100000:3.0:1789135747.283104:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135747.283153:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789135747.283174:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666648960 00000100:00100000:1.0:1789135747.283180:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666648960 00000100:00100000:1.0:1789135747.283232:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135747.283241:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c991044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:7922:x1876044666648960:12345-0@lo:104: 00010000:00010000:1.0:1789135747.283253:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.283315:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135747.283320:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c991044 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:7922:x1876044666648960:12345-0@lo:104: Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135747.283327:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789135747.283372:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135747.283377:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.283384:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a81de015 already unused, calling callback (00000000b40e24c4) 10000000:00010000:1.0:1789135747.283387:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.283394:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135747.283400:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135747.283405:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135747.283433:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.283441:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135747.283477:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.283485:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de2657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de265e expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.283507:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135747.283509:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135747.283511:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135747.284457:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135747.284476:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008626b2b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666649088:0@lo:103: 00000100:00100000:3.0:1789135747.284524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135747.284608:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649088 00000100:00100000:3.0:1789135747.284613:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649088 00010000:00010000:3.0:1789135747.284633:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2657 expref: 18 pid: 6508 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135747.284783:0:7922:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2569 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135747.284793:0:7922:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2569 expref: 18 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135747.284801:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000025da8667 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876044666649216:0@lo:104: 00000100:00100000:2.0:1789135747.284848:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135747.284885:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set 00000000652ae9af going to sleep for 11 seconds 00000100:00100000:2.0:1789135747.284907:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bd2545e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876044666648960:0@lo:104: 00000100:00100000:3.0:1789135747.286149:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789135747.286173:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b2fedb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3638:x1876044666649088:12345-0@lo:103: 00010000:00010000:3.0:1789135747.286190:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135747.286197:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2657 expref: 18 pid: 6508 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.286208:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2657 expref: 18 pid: 6508 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.286224:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000063a1fe34/0x559c8745c6de265e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2657 expref: 18 pid: 6508 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.286239:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135747.286414:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649216 00000100:00100000:1.0:1789135747.286421:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649216 00000100:00100000:1.0:1789135747.286456:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135747.287283:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce126adc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:7922:x1876044666649216:12345-0@lo:104: 00010000:00010000:1.0:1789135747.287309:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135747.289890:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008626b2b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666649088:0@lo:103: 00000100:00100000:3.0:1789135747.290297:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b2fedb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3638:x1876044666649088:12345-0@lo:103: Request processed in 4125us (5770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135747.290312:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789135747.290745:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135747.290752:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce126adc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:7922:x1876044666649216:12345-0@lo:104: Request processed in 4290us (5904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135747.290761:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789135747.291140:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000025da8667 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7922:1876044666649216:0@lo:104: 00010000:00010000:2.0:1789135747.291168:0:7922:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.291376:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135747.291382:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.291390:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000903077df already unused, calling callback (00000000b40e24c4) 10000000:00010000:3.0:1789135747.291394:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.291403:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135747.291409:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135747.291414:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135747.291468:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.291475:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789135747.291574:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cf65a0e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666649344:0@lo:103: 00000100:00100000:0.0:1789135747.291621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135747.293241:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.293256:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000903077df/0x559c8745c6de2569 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2570 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135747.293275:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135747.293277:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135747.293278:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135747.293506:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649344 00000100:00100000:0.0:1789135747.293515:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649344 00010000:00010000:0.0:1789135747.293551:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2569 expref: 17 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135747.293594:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789135747.293602:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000641ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3640:x1876044666649344:12345-0@lo:103: 00010000:00010000:0.0:1789135747.293614:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135747.293617:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2569 expref: 17 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293628:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2569 expref: 17 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293670:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000335b8403/0x559c8745c6de2570 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2569 expref: 17 pid: 6510 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293682:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293689:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293705:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293711:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293717:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293722:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293727:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a9bf77e already unused, calling callback (000000007c73147a) 00010000:00010000:0.0:1789135747.293730:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.293736:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.294197:0:7922:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135747.294207:0:7922:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.301643:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.301747:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a9bf77e/0x559c8745c6de26f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135747.301770:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135747.302437:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000641ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3640:x1876044666649344:12345-0@lo:103: Request processed in 8832us (10811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135747.302449:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789135747.302492:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cf65a0e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666649344:0@lo:103: 00010000:00010000:3.0:1789135748.264739:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135748.457347:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135748.457372:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009dda063c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666649472:0@lo:41: 00000100:00100000:0.0:1789135748.457458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135748.457527:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649472 00000100:00100000:0.0:1789135748.457534:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649472 00000100:00100000:0.0:1789135748.457578:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135748.457585:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5aacb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666649472:12345-0@lo:41: 00000004:00000024:0.0:1789135748.457618:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789135748.457668:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5aacb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666649472:12345-0@lo:41: Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135748.457675:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135748.457718:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009dda063c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666649472:0@lo:41: 00010000:00010000:3.0:1789135749.293224:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135750.000501:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666649600:0@lo:41: 00000100:00100000:2.0:1789135750.001065:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135750.001212:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666650112:0@lo:400: 00000100:00100000:0.0:1789135750.001716:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000071adbbf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666649728:0@lo:400: 00000100:00100000:0.0:1789135750.001754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135750.001916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649600 00000100:00100000:3.0:1789135750.001924:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649600 00000100:00100000:3.0:1789135750.001972:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135750.001980:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025da8667 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666649600:12345-0@lo:41: 00000004:00000024:3.0:1789135750.002024:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789135750.002066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025da8667 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666649600:12345-0@lo:41: Request processed in 87us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135750.002074:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789135750.002151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135750.002184:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0e0fbb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666649856:0@lo:400: 00000100:00100000:2.0:1789135750.002226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135750.002414:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649728 00000100:00100000:1.0:1789135750.002419:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649728 00000100:00100000:1.0:1789135750.002457:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135750.002464:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a320d147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3639:x1876044666649728:12345-0@lo:400: 00000100:00100000:3.0:1789135750.002524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650112 00000100:00100000:3.0:1789135750.002528:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650112 00000100:00100000:3.0:1789135750.002553:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649856 00000100:00100000:3.0:1789135750.002556:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649856 00000100:00100000:3.0:1789135750.002569:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789135750.002574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d229cdc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666650112:12345-0@lo:400: 00000100:00100000:2.0:1789135750.002770:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135750.002778:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084c81551 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666649984:0@lo:400: 00000100:00100000:1.0:1789135750.003487:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a320d147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3639:x1876044666649728:12345-0@lo:400: Request processed in 1023us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135750.003496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789135750.003541:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000071adbbf2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666649728:0@lo:400: 00000100:00100000:3.0:1789135750.008100:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d229cdc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666650112:12345-0@lo:400: Request processed in 5514us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135750.008134:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789135750.008175:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135750.008188:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a6c184 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666649856:12345-0@lo:400: 00000100:00100000:3.0:1789135750.008266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a6c184 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666649856:12345-0@lo:400: Request processed in 85us (6041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135750.008272:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135750.009165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789135750.009336:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d0e0fbb5 x1876044666649856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135750.009351:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0e0fbb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666649856:0@lo:400: 00010000:00080000:2.0:1789135750.009424:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000be331606 x1876044666650112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135750.009433:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be331606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666650112:0@lo:400: 00000100:00100000:2.0:1789135750.009473:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000653daca4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666649600:0@lo:41: 00000100:00100000:0.0:1789135750.011356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666649984 00000100:00100000:0.0:1789135750.011372:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666649984 00000100:00100000:0.0:1789135750.012909:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135750.012925:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099da221f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666649984:12345-0@lo:400: 00000100:00100000:0.0:1789135750.013074:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099da221f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666649984:12345-0@lo:400: Request processed in 154us (3911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135750.013090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135750.013202:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084c81551 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666649984:0@lo:400: 00010000:00010000:2.0:1789135750.312917:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135751.148926:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135751.148934:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 1 10000000:01000000:1.0:1789135751.148938:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135751.148995:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de26f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.149008:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de26f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.149019:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de26f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135751.149041:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650240:0@lo:101: 00000100:00100000:1.0:1789135751.149108:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.149172:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032023fd6 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.149193:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650240 00000100:00100000:1.0:1789135751.149200:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650240 00000100:00100000:1.0:1789135751.149260:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135751.149268:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032a4db8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666650240:12345-0@lo:101: 00010000:00010000:1.0:1789135751.149281:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135751.149293:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fee86da/0x559c8745c6de26ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de26f8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.149327:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fee86da/0x559c8745c6de26ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.149336:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fee86da/0x559c8745c6de26ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.149344:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fee86da, rc 0) 00000100:00100000:1.0:1789135751.149380:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032a4db8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666650240:12345-0@lo:101: Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.149387:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789135751.149429:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650240:0@lo:101: 00010000:00010000:1.0:1789135751.149442:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de26f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.149449:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000a81de015/0x559c8745c6de26f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135751.149504:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650368:0@lo:501: 00000100:00100000:1.0:1789135751.149529:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.149541:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032023fd6 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.149552:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650368 00000100:00100000:1.0:1789135751.149555:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650368 00000100:00100000:1.0:1789135751.149574:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789135751.149580:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d6b02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666650368:12345-0@lo:501: 00000100:00100000:1.0:1789135751.149690:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d6b02e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666650368:12345-0@lo:501: Request processed in 111us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.149710:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789135751.149746:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650368:0@lo:501: 00000100:00100000:1.0:1789135751.149771:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650496:0@lo:503: 00000100:00100000:1.0:1789135751.149806:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.149818:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032023fd6 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.149829:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650496 00000100:00100000:1.0:1789135751.149832:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650496 00000100:00100000:1.0:1789135751.149871:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789135751.149878:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000983d8c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666650496:12345-0@lo:503: 00000100:00100000:1.0:1789135751.149949:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000983d8c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666650496:12345-0@lo:503: Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.149956:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789135751.150003:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650496:0@lo:503: 00000100:00100000:1.0:1789135751.150214:0:8103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8103:1876044666650624:0@lo:502: 00000100:00100000:1.0:1789135751.150244:0:8103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.150264:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650624 00000100:00100000:1.0:1789135751.150268:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650624 00000100:00100000:1.0:1789135751.150289:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789135751.150294:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001885a693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8103:x1876044666650624:12345-0@lo:502: 00000100:00100000:1.0:1789135751.150362:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001885a693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8103:x1876044666650624:12345-0@lo:502: Request processed in 68us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.150368:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789135751.150394:0:8103:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032023fd6 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.150406:0:8103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba0bb797 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8103:1876044666650624:0@lo:502: 00000020:01000000:1.0:1789135751.150424:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135751.150433:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135751.150436:0:8103:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789135751.150447:0:8103:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7fa5f7000 00000020:00000080:1.0:1789135751.150450:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135751.150487:0:8103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8103:1876044666650752:0@lo:502: 00000100:00100000:1.0:1789135751.150516:0:8103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.150535:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650752 00000100:00100000:1.0:1789135751.150538:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650752 00000100:00100000:1.0:1789135751.150557:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135751.150563:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8103:x1876044666650752:12345-0@lo:502: 00000100:00100000:1.0:1789135751.150615:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8103:x1876044666650752:12345-0@lo:502: Request processed in 51us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.150621:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135751.150649:0:8103:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.150660:0:8103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8103:1876044666650752:0@lo:502: 00000020:01000000:1.0:1789135751.150677:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135751.150681:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135751.150683:0:8103:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789135751.150686:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789135751.150736:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789135751.150753:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135751.150760:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.150769:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135751.150778:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135751.150780:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 1 10000000:01000000:1.0:1789135751.150782:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135751.150801:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.150813:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.150822:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135751.150834:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650880:0@lo:101: 00000100:00100000:1.0:1789135751.150881:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.150894:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.150906:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666650880 00000100:00100000:1.0:1789135751.150909:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666650880 00000100:00100000:1.0:1789135751.150928:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789135751.150934:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666650880:12345-0@lo:101: 00010000:00010000:1.0:1789135751.150941:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135751.150950:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2706 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.150966:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2706 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.150976:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2706 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.150996:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167de00, rc 0) 00000100:00100000:1.0:1789135751.151026:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666650880:12345-0@lo:101: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.151032:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789135751.151061:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666650880:0@lo:101: 00010000:00010000:1.0:1789135751.151077:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.151084:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135751.151122:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666651008:0@lo:501: 00000100:00100000:1.0:1789135751.151144:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.151157:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.151168:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651008 00000100:00100000:1.0:1789135751.151171:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651008 00000100:00100000:1.0:1789135751.151190:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135751.151195:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666651008:12345-0@lo:501: 00000100:00100000:1.0:1789135751.151265:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666651008:12345-0@lo:501: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.151271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135751.151298:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666651008:0@lo:501: 00000100:00100000:1.0:1789135751.151320:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666651136:0@lo:503: 00000100:00100000:1.0:1789135751.151351:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.151364:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.151374:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651136 00000100:00100000:1.0:1789135751.151378:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651136 00000100:00100000:1.0:1789135751.151396:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135751.151401:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666651136:12345-0@lo:503: 00000100:00100000:1.0:1789135751.151457:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666651136:12345-0@lo:503: Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.151463:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135751.151500:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666651136:0@lo:503: 00000100:00100000:1.0:1789135751.151710:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8104:1876044666651264:0@lo:502: 00000100:00100000:1.0:1789135751.151740:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.151758:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651264 00000100:00100000:1.0:1789135751.151761:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651264 00000100:00100000:1.0:1789135751.151782:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135751.151787:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8104:x1876044666651264:12345-0@lo:502: 00000100:00100000:1.0:1789135751.151843:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8104:x1876044666651264:12345-0@lo:502: Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.151849:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135751.151897:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7348b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.151908:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8104:1876044666651264:0@lo:502: 00000020:01000000:1.0:1789135751.151926:0:8104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135751.151932:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135751.151934:0:8104:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789135751.151939:0:8104:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7d26b4800 00000020:00000080:1.0:1789135751.151941:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135751.151957:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8104:1876044666651392:0@lo:502: 00000100:00100000:1.0:1789135751.167177:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135751.167265:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651392 00000100:00100000:1.0:1789135751.167275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651392 00000100:00100000:1.0:1789135751.167327:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789135751.167339:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8104:x1876044666651392:12345-0@lo:502: 00000100:00100000:1.0:1789135751.167482:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8104:x1876044666651392:12345-0@lo:502: Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135751.167490:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789135751.167558:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7348b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135751.167588:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8104:1876044666651392:0@lo:502: 00000020:01000000:1.0:1789135751.167632:0:8104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135751.167640:0:8104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135751.167642:0:8104:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789135751.167647:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789135751.167714:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789135751.167736:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135751.167746:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135751.167758:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135751.349678:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135752.361004:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135753.385084:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135753.578419:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135753.578446:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666651520:0@lo:41: 00000100:00100000:1.0:1789135753.578522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135753.578638:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651520 00000100:00100000:3.0:1789135753.578647:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651520 00000100:00100000:3.0:1789135753.578694:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135753.578702:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666651520:12345-0@lo:41: 00000004:00000024:3.0:1789135753.578738:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789135753.578804:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666651520:12345-0@lo:41: Request processed in 101us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135753.578813:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789135753.578880:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666651520:0@lo:41: 00010000:00010000:3.0:1789135754.411951:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135755.112368:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135755.112409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666651648:0@lo:41: 00000100:00100000:2.0:1789135755.112507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135755.112610:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651648 00000100:00100000:2.0:1789135755.112620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651648 00000100:00100000:2.0:1789135755.112692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135755.112702:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666651648:12345-0@lo:41: 00000004:00000024:2.0:1789135755.112752:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789135755.112807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666651648:12345-0@lo:41: Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135755.112815:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135755.112895:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666651648:0@lo:41: 00000100:00100000:1.0:1789135755.113503:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666652160:0@lo:400: 00000100:00100000:1.0:1789135755.113551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135755.113588:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135755.113595:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666651776:0@lo:400: 00000100:00100000:1.0:1789135755.113627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135755.113658:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666651904:0@lo:400: 00000100:00100000:1.0:1789135755.113685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135755.113704:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135755.113709:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f64121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666652032:0@lo:400: 00000100:00100000:1.0:1789135755.113737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135755.113769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652160 00000100:00100000:1.0:1789135755.113781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652160 00000100:00100000:1.0:1789135755.113820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651904 00000100:00100000:1.0:1789135755.113823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651904 00000100:00100000:1.0:1789135755.113838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135755.113844:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666652160:12345-0@lo:400: 00000100:00100000:3.0:1789135755.114099:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652032 00000100:00100000:3.0:1789135755.114103:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652032 00000100:00100000:3.0:1789135755.114137:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135755.114145:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666652032:12345-0@lo:400: 00000100:00100000:3.0:1789135755.117079:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666652032:12345-0@lo:400: Request processed in 2912us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135755.117101:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789135755.121075:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789135755.121101:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789135755.121132:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789135755.121290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135755.121311:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666651904:12345-0@lo:400: 00000100:00100000:0.0:1789135755.121444:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6410b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666651904:12345-0@lo:400: Request processed in 141us (7757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135755.121452:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135755.121499:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666651776 00000100:00100000:0.0:1789135755.121509:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666651776 00000100:00100000:0.0:1789135755.121557:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789135755.121564:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3640:x1876044666651776:12345-0@lo:400: 00000100:00100000:0.0:1789135755.121602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3640:x1876044666651776:12345-0@lo:400: Request processed in 38us (7973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135755.121608:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789135755.124496:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666652160:12345-0@lo:400: Request processed in 10636us (10929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135755.124517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789135755.124640:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666651776:0@lo:400: 00010000:00080000:1.0:1789135755.124663:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f6412d00 x1876044666652160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135755.124679:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6412d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666652160:0@lo:400: 00000100:00100000:0.0:1789135755.127678:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f64121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666652032:0@lo:400: 00010000:00080000:0.0:1789135755.127717:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f6413840 x1876044666651904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135755.127731:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666651904:0@lo:400: 00010000:00010000:0.0:1789135755.432076:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135756.458688:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135757.481816:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789135757.610482:0:8423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789135757.610488:0:8423:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789135757.610489:0:8423:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789135757.610623:0:8423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7e761a000 00000020:01000004:2.0:1789135757.610640:0:8423:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789135757.610654:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789135757.610669:0:8423:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a7d184ced8) 00000020:00000080:2.0:1789135757.610686:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789135757.669615:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789135757.669948:0:8423:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1789135757.707487:0:8423:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789135757.707706:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789135757.707720:0:8423:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789135757.707731:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x559c8745c6de271b 00000020:01000004:1.0:1789135757.707738:0:8423:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789135757.707759:0:8423:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789135757.707763:0:8423:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789135757.707769:0:8423:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789135757.707773:0:8423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789135757.707784:0:8423:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a7e6e9ced8) 00000020:00000080:1.0:1789135757.707796:0:8423:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1789135757.710311:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789135757.710490:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789135757.710495:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789135757.711421:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789135757.711430:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789135757.718274:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789135757.718292:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789135757.727813:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135757.728118:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789135757.728124:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789135757.731583:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789135757.731596:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789135757.761212:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789135757.761478:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789135757.761485:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789135757.768220:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789135757.768235:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789135757.770186:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789135757.770198:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789135757.773770:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135757.774044:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789135757.774051:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789135757.774777:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789135757.774796:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789135757.825832:0:8423:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789135757.826203:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789135757.826210:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789135757.828264:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789135757.828277:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789135757.828753:0:8423:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789135757.828793:0:8423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789135757.828800:0:8423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789135757.847209:0:8423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789135757.847253:0:8423:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789135757.847256:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789135757.847258:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135757.847259:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135757.847260:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135757.847261:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135757.847263:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135757.847264:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135757.847265:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135757.847266:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135757.847268:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135757.847269:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135757.847272:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789135757.847274:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135757.847275:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789135757.847276:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135757.847277:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135757.847279:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135757.847280:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135757.847281:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135757.847282:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135757.847283:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135757.847284:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135757.847285:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789135757.847313:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789135757.847332:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666652288:0@lo:253: 00000100:00100000:2.0:1789135757.847407:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.847547:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.847706:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652288 00000100:00100000:1.0:1789135757.847714:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652288 00000100:00100000:1.0:1789135757.847789:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135757.847799:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8423:x1876044666652288:12345-0@lo:253: 20000000:01000000:1.0:1789135757.847829:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789135757.847832:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789135757.847838:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789135757.847841:0:6509:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789135757.848333:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135757.848460:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789135757.848476:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789135757.848492:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789135757.848497:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789135757.848507:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789135757.848520:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789135757.848599:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789135757.848613:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1789135757.848615:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135757.848702:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789135757.848711:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135757.848728:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789135757.848735:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135757.848746:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789135757.848752:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789135757.848762:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789135757.848775:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789135757.848838:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789135757.848847:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1789135757.848955:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135757.848973:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789135757.848979:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135757.849003:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789135757.849009:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135757.849021:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789135757.849026:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789135757.849038:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789135757.849052:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1789135757.849523:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1789135757.849537:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1789135757.849539:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135757.849552:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1789135757.849557:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789135757.849568:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1789135757.849572:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135757.849583:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1789135757.849588:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789135757.849598:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1789135757.849611:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1789135757.849622:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789135757.849697:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789135757.849701:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789135757.849745:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789135757.849748:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135757.850452:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135757.850493:0:8442:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135757.850509:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789135757.850808:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789135757.850828:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789135757.850840:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789135757.850848:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789135757.850850:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789135757.851553:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789135757.851790:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789135757.851809:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789135757.851833:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789135757.851845:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789135757.851847:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135757.852321:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135757.852347:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135757.852362:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789135757.852520:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789135757.852538:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789135757.852550:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789135757.852558:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789135757.852560:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135757.853038:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135757.853059:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135757.853074:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789135757.853264:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789135757.853281:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789135757.853293:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1789135757.853305:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789135757.853324:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853342:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de25ee expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853350:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2665 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853357:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de269d expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853363:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853370:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853376:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853422:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853437:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 18 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.853451:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666652416:0@lo:104: 00000100:00100000:1.0:1789135757.853512:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135757.853599:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853607:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 18 pid: 6508 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.853615:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666652544:0@lo:104: 00000100:00100000:1.0:1789135757.853647:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135757.853770:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de269d expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.853779:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de269d expref: 18 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.853786:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f64121c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666652672:0@lo:104: 00000100:00100000:1.0:1789135757.853808:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.855770:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652416 00000100:00100000:2.0:1789135757.855783:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652416 00000100:00100000:2.0:1789135757.855842:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652544 00000100:00100000:2.0:1789135757.855845:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652544 00000100:00100000:2.0:1789135757.855905:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135757.855915:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6509:x1876044666652416:12345-0@lo:104: 00010000:00010000:2.0:1789135757.855931:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856007:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135757.856015:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6509:x1876044666652416:12345-0@lo:104: Request processed in 101us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.856022:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135757.856042:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135757.856049:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6509:x1876044666652544:12345-0@lo:104: 00010000:00010000:2.0:1789135757.856056:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856089:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789135757.856094:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6509:x1876044666652544:12345-0@lo:104: Request processed in 46us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.856110:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789135757.856152:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789135757.856158:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856165:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135757.856169:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856177:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135757.856184:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135757.856190:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135757.856227:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856233:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135757.856253:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856261:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de26e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856275:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135757.856277:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856283:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135757.856287:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856304:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135757.856310:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135757.856315:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135757.856330:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856336:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135757.856349:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856357:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167d000/0x559c8745c6de26b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26c0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.856366:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.856368:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.856370:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.856376:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135757.856396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666652800:0@lo:103: 00000100:00100000:2.0:1789135757.856431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.856480:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135757.856489:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666652928:0@lo:103: 00000100:00100000:2.0:1789135757.856511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.856536:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652800 00000100:00100000:2.0:1789135757.856540:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652800 00010000:00010000:2.0:1789135757.856558:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 19 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135757.856586:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652928 00000100:00100000:2.0:1789135757.856589:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652928 00010000:00010000:2.0:1789135757.856601:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 20 pid: 6508 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135757.856613:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135757.856619:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666652800:12345-0@lo:103: 00000100:00100000:0.0:1789135757.856822:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789135757.856832:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789135757.857005:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135757.857014:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3639:x1876044666652928:12345-0@lo:103: 00010000:00010000:0.0:1789135757.857025:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135757.857037:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 20 pid: 6508 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.857048:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 20 pid: 6508 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.857067:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135757.857111:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3639:x1876044666652928:12345-0@lo:103: Request processed in 99us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135757.857119:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789135757.857308:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135757.857315:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 19 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.857325:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 19 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.857334:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135757.857370:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:3641:x1876044666652800:12345-0@lo:103: Request processed in 752us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.857377:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135757.857410:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666652928:0@lo:103: 00000100:00100000:0.0:1789135757.858760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666652800:0@lo:103: 00010000:00010000:1.0:1789135757.858934:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2665 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.858949:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2665 expref: 18 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.858980:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6411680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666653056:0@lo:104: 00000100:00100000:1.0:1789135757.859034:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135757.859053:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de25ee expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.859063:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de25ee expref: 18 pid: 6510 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.859072:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666653184:0@lo:104: 00000100:00100000:1.0:1789135757.859090:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135757.859112:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc300 going to sleep for 11 seconds 00010000:00010000:1.0:1789135757.859127:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167d600/0x559c8745c6de26ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de26e3 expref: 18 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.859140:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666652416:0@lo:104: 00010000:00010000:1.0:1789135757.859150:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de26c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de26b9 expref: 17 pid: 6508 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.859159:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666652544:0@lo:104: 00000100:00100000:2.0:1789135757.859783:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666652672 00000100:00100000:2.0:1789135757.859791:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666652672 00000100:00100000:2.0:1789135757.859829:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653056 00000100:00100000:2.0:1789135757.859832:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653056 00000100:00100000:2.0:1789135757.859841:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653184 00000100:00100000:2.0:1789135757.859844:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653184 00000100:00100000:2.0:1789135757.859892:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135757.859902:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6412d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6509:x1876044666652672:12345-0@lo:104: 00010000:00010000:2.0:1789135757.859917:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.859985:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135757.859990:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6412d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6509:x1876044666652672:12345-0@lo:104: Request processed in 91us (6182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.859998:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135757.860014:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135757.860020:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6509:x1876044666653056:12345-0@lo:104: 00010000:00010000:2.0:1789135757.860028:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.860072:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789135757.860077:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6509:x1876044666653056:12345-0@lo:104: Request processed in 58us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.860084:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135757.860096:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789135757.860201:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135757.860208:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860216:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135757.860220:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860229:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135757.860237:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135757.860244:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135757.860276:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860282:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135757.860305:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860313:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de269d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26a4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860328:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135757.860332:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860339:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ca00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135757.860342:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860349:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135757.860355:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135757.860361:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135757.860374:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860380:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135757.860391:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860399:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de266c expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860409:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135757.860415:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135757.860417:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135757.860438:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135757.860452:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9679a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666653312:0@lo:103: 00000100:00100000:0.0:1789135757.860487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135757.860531:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653312 00000100:00100000:0.0:1789135757.860535:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653312 00010000:00010000:0.0:1789135757.860556:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de269d expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135757.860579:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135757.860586:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3638:x1876044666653312:12345-0@lo:103: 00010000:00010000:0.0:1789135757.860597:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135757.860603:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de269d expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860614:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de269d expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860643:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135757.860669:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3638:x1876044666653312:12345-0@lo:103: Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135757.860676:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135757.860692:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135757.860700:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666653440:0@lo:103: 00000100:00100000:0.0:1789135757.860734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135757.860770:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9679a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666653312:0@lo:103: 00000100:00100000:0.0:1789135757.860792:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653440 00000100:00100000:0.0:1789135757.860795:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653440 00010000:00010000:0.0:1789135757.860813:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2665 expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135757.860835:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135757.860841:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23130c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3641:x1876044666653440:12345-0@lo:103: 00010000:00010000:0.0:1789135757.860848:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135757.860878:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2665 expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860889:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2665 expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135757.860899:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135757.860924:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23130c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3641:x1876044666653440:12345-0@lo:103: Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135757.860931:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135757.860951:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666653440:0@lo:103: 00000100:00100000:2.0:1789135757.861199:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6509:x1876044666653184:12345-0@lo:104: 00010000:00010000:2.0:1789135757.861208:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861253:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135757.861258:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6509:x1876044666653184:12345-0@lo:104: Request processed in 64us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.861264:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789135757.861284:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135757.861289:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861296:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135757.861305:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861314:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135757.861321:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135757.861327:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135757.861346:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861352:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135757.861364:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861372:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de25ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de25f5 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861385:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.861387:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.861389:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135757.861401:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135757.861410:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666653568:0@lo:103: 00000100:00100000:2.0:1789135757.861439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.861475:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653568 00000100:00100000:2.0:1789135757.861480:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653568 00010000:00010000:2.0:1789135757.861495:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de25ee expref: 17 pid: 6510 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135757.861511:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135757.861522:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3640:x1876044666653568:12345-0@lo:103: 00010000:00010000:2.0:1789135757.861530:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135757.861534:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de25ee expref: 17 pid: 6510 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861543:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de25ee expref: 17 pid: 6510 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861556:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861565:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861579:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861587:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861593:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861599:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861605:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135757.861609:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.861616:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.862244:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031200/0x559c8745c6de26a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de269d expref: 17 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.862258:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f64121c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666652672:0@lo:104: 00010000:00010000:1.0:1789135757.862269:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031e00/0x559c8745c6de266c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2665 expref: 16 pid: 6509 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.862277:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6411680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666653056:0@lo:104: 00010000:00010000:1.0:1789135757.862296:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de25f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de25ee expref: 15 pid: 6510 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.862306:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1876044666653184:0@lo:104: 00010000:00010000:1.0:1789135757.862334:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.862343:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.862350:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789135757.862359:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1789135757.863187:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.863426:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.863435:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de2729 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.863453:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135757.863565:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:3640:x1876044666653568:12345-0@lo:103: Request processed in 2041us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.863576:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789135757.866082:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+13:8423:x1876044666652288:12345-0@lo:253: Request processed in 18275us (18665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135757.866106:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789135757.866207:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666652288:0@lo:253: 10000000:01000000:3.0:1789135757.866221:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789135757.866225:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135757.866227:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135757.866228:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135757.866230:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789135757.866231:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135757.866233:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135757.866235:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135757.866237:0:8423:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789135757.866238:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135757.866240:0:8423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789135757.866264:0:8423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7e761a000 from lustre-OST0000 10000000:01000000:3.0:1789135757.866317:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789135757.866320:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789135757.866329:0:8423:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a7efa18000 local copy 10000000:01000000:3.0:1789135757.866333:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789135757.866375:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.866385:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.866406:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.866424:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666653696:0@lo:101: 00000100:00100000:3.0:1789135757.866461:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.866505:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.866561:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653696 00000100:00100000:1.0:1789135757.866568:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653696 00000100:00100000:1.0:1789135757.866615:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135757.866633:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+13:8423:x1876044666653696:12345-0@lo:101: 00010000:00010000:1.0:1789135757.866650:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135757.866663:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2730 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.866692:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2730 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.866704:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2730 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.866712:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878000, rc 0) 00000100:00100000:1.0:1789135757.866755:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:8423:x1876044666653696:12345-0@lo:101: Request processed in 132us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135757.866769:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135757.866920:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666653696:0@lo:101: 00010000:00010000:3.0:1789135757.866932:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.866941:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.867023:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666653824:0@lo:501: 00000100:00100000:3.0:1789135757.867047:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.867071:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.867137:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653824 00000100:00100000:1.0:1789135757.867141:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653824 00000100:00100000:1.0:1789135757.867162:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135757.867169:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+14:8423:x1876044666653824:12345-0@lo:501: 00000100:00100000:1.0:1789135757.867218:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+14:8423:x1876044666653824:12345-0@lo:501: Request processed in 49us (170us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135757.867225:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789135757.867288:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666653824:0@lo:501: 10000000:01000000:3.0:1789135757.867300:0:8423:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789135757.867316:0:8423:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789135757.867321:0:8423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867330:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867338:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867357:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789135757.867376:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7e761a000 10000000:01000000:3.0:1789135757.867381:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789135757.867386:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789135757.867389:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135757.867394:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789135757.867397:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789135757.867411:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867418:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867425:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.867436:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666653952:0@lo:101: 00000100:00100000:3.0:1789135757.867461:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.867481:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f68869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.867496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666653952 00000100:00100000:3.0:1789135757.867499:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666653952 00000100:00100000:3.0:1789135757.867515:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789135757.867522:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:8423:x1876044666653952:12345-0@lo:101: 00010000:00010000:3.0:1789135757.867529:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135757.867536:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de273e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867551:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de273e expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867566:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de273e expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867574:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a8021dde00, rc 0) 00000100:00100000:3.0:1789135757.867601:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666653952:12345-0@lo:101: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.867607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789135757.867648:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666653952:0@lo:101: 00010000:00010000:3.0:1789135757.867658:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.867665:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.867710:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654080:0@lo:501: 00000100:00100000:3.0:1789135757.867734:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.867747:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f68869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.867758:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654080 00000100:00100000:3.0:1789135757.867761:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654080 00000100:00100000:3.0:1789135757.867777:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789135757.867782:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654080:12345-0@lo:501: 00000100:00100000:3.0:1789135757.867910:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654080:12345-0@lo:501: Request processed in 126us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.867916:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789135757.867957:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654080:0@lo:501: 00000100:00100000:3.0:1789135757.867982:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654208:0@lo:503: 00000100:00100000:3.0:1789135757.868022:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.868034:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f68869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.868045:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654208 00000100:00100000:3.0:1789135757.868048:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654208 00000100:00100000:3.0:1789135757.868064:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789135757.868069:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654208:12345-0@lo:503: 00000100:00100000:3.0:1789135757.868146:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654208:12345-0@lo:503: Request processed in 76us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.868153:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789135757.868189:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654208:0@lo:503: 00000040:00080000:3.0:1789135757.868402:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135757.868470:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654336:0@lo:502: 00000100:00100000:3.0:1789135757.868501:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.868516:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f68869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.868531:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654336 00000100:00100000:3.0:1789135757.868535:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654336 00000100:00100000:3.0:1789135757.868552:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789135757.868558:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654336:12345-0@lo:502: 00000100:00100000:3.0:1789135757.868627:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654336:12345-0@lo:502: Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.868634:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789135757.868670:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654336:0@lo:502: 00000040:00080000:3.0:1789135757.868918:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789135757.868942:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789135757.868955:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789135757.868967:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789135757.868978:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789135757.869000:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789135757.869017:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654464:0@lo:502: 00000100:00100000:3.0:1789135757.869048:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.869060:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d6029180 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.869072:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654464 00000100:00100000:3.0:1789135757.869076:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654464 00000100:00100000:3.0:1789135757.869092:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135757.869097:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654464:12345-0@lo:502: 00000100:00100000:3.0:1789135757.869154:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654464:12345-0@lo:502: Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.869162:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135757.869194:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654464:0@lo:502: 00000040:00080000:3.0:1789135757.869224:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789135757.869230:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:2.0:1789135757.869826:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135757.869835:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.869845:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135757.869849:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.869892:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135757.869899:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135757.869905:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135757.869931:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.869945:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135757.869965:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.869972:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2730 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de2737 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.869984:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.869986:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135757.869988:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135757.870065:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666654592:0@lo:103: 00000100:00100000:1.0:1789135757.870115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135757.871702:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654592 00000100:00100000:1.0:1789135757.871714:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654592 00000100:00100000:1.0:1789135757.871780:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135757.871788:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3638:x1876044666654592:12345-0@lo:103: 00010000:00010000:1.0:1789135757.871801:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135757.871819:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2730 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.871834:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135757.871914:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+14:3638:x1876044666654592:12345-0@lo:103: Request processed in 127us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135757.871921:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135757.871955:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666654592:0@lo:103: 00000100:00100000:0.0:1789135757.872294:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666653568:0@lo:103: 00000020:01000000:2.0:1789135757.872568:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789135757.872575:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789135757.872581:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135757.872583:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789135757.872590:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789135757.872605:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a7d1849a48) 00000020:00000080:2.0:1789135757.872730:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789135757.872740:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789135757.872811:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7e761a000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789135757.872819:0:8447:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789135757.872827:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x559c8745c6de2753 00010000:00010000:2.0:1789135757.879192:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789135757.879477:0:8447:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789135757.882819:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789135757.883292:0:8447:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789135757.888515:0:8447:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789135757.889003:0:8447:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789135757.894774:0:8447:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789135757.896653:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789135757.896666:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135757.896678:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135757.896680:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789135757.896684:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135757.896688:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135757.896689:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135757.896693:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135757.896694:0:8447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789135757.896712:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135757.896715:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135757.896716:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789135757.896719:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789135757.896989:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789135757.897018:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789135757.897036:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.897049:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135757.897057:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7e761a000 from 1 10000000:01000000:3.0:1789135757.897059:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135757.897094:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.897114:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.897136:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.897159:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654720:0@lo:101: 00000100:00100000:3.0:1789135757.897225:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.897280:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.897388:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654720 00000100:00100000:1.0:1789135757.897395:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654720 00000100:00100000:1.0:1789135757.897446:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135757.897456:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:8423:x1876044666654720:12345-0@lo:101: 00010000:00010000:1.0:1789135757.897476:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135757.897489:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de275a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.897515:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de275a expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.897526:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de275a expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.897535:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878000, rc 0) 00000100:00100000:1.0:1789135757.897572:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654720:12345-0@lo:101: Request processed in 118us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135757.897578:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789135757.897797:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654720:0@lo:101: 00010000:00010000:3.0:1789135757.897812:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.897821:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.897938:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654848:0@lo:501: 00000100:00100000:3.0:1789135757.897964:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.897990:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.898007:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654848 00000100:00100000:3.0:1789135757.898010:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654848 00000100:00100000:3.0:1789135757.898035:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789135757.898041:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654848:12345-0@lo:501: 00000100:00100000:3.0:1789135757.898258:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654848:12345-0@lo:501: Request processed in 216us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.898265:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135757.898323:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654848:0@lo:501: 00000100:00100000:1.0:1789135757.898349:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654976:0@lo:503: 00000100:00100000:1.0:1789135757.898386:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135757.898407:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.898443:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666654976 00000100:00100000:3.0:1789135757.898447:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666654976 00000100:00100000:3.0:1789135757.898474:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789135757.898480:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654976:12345-0@lo:503: 00000100:00100000:3.0:1789135757.898556:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666654976:12345-0@lo:503: Request processed in 75us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.898563:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789135757.898642:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666654976:0@lo:503: 00000040:00080000:1.0:1789135757.898837:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789135757.898930:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655104:0@lo:502: 00000100:00100000:1.0:1789135757.898963:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135757.898978:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.898991:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655104 00000100:00100000:1.0:1789135757.898995:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655104 00000100:00100000:1.0:1789135757.899011:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135757.899016:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666655104:12345-0@lo:502: 00000100:00100000:1.0:1789135757.899085:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666655104:12345-0@lo:502: Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135757.899092:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135757.899134:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655104:0@lo:502: 00000040:00080000:1.0:1789135757.899286:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789135757.899307:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789135757.899324:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655232:0@lo:502: 00000100:00100000:1.0:1789135757.899353:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135757.899361:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.899377:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655232 00000100:00100000:1.0:1789135757.899380:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655232 00000100:00100000:1.0:1789135757.899395:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135757.899400:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666655232:12345-0@lo:502: 00000100:00100000:1.0:1789135757.899456:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666655232:12345-0@lo:502: Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135757.899463:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135757.899498:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655232:0@lo:502: 00000040:00080000:1.0:1789135757.899536:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789135757.899543:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789135757.900167:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135757.900177:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135757.900179:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789135757.900184:0:8450:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7e761a000 00000020:00000080:1.0:1789135757.900186:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789135757.900196:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135757.900199:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135757.900200:0:8450:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789135757.900202:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789135757.900312:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789135757.900334:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135757.900354:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.900364:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135757.900412:0:8423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789135757.900416:0:8423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7e761a000 10000000:01000000:2.0:1789135757.900419:0:8423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7e761a000 10000000:01000000:2.0:1789135757.900423:0:8423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789135757.900428:0:8423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7e761a000 from 1 10000000:01000000:2.0:1789135757.900430:0:8423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135757.900456:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.900463:0:8423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.900473:0:8423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135757.900494:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655360:0@lo:101: 00000100:00100000:2.0:1789135757.900529:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.900563:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c1086240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135757.900693:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655360 00000100:00100000:1.0:1789135757.900698:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655360 00000100:00100000:1.0:1789135757.900729:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789135757.900736:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8423:x1876044666655360:12345-0@lo:101: 00010000:00010000:1.0:1789135757.900745:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135757.900757:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2768 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.900775:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2768 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.900785:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2768 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.900792:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879600, rc 0) 00000100:00100000:1.0:1789135757.900832:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655360:12345-0@lo:101: Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135757.900837:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789135757.900981:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655360:0@lo:101: 00010000:00010000:2.0:1789135757.900995:0:8423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135757.901002:0:8423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135757.901068:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655488:0@lo:501: 00000100:00100000:2.0:1789135757.901092:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.901223:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c1086240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.903523:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655488 00000100:00100000:3.0:1789135757.903535:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655488 00000100:00100000:3.0:1789135757.903596:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789135757.903606:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655488:12345-0@lo:501: 00000100:00100000:3.0:1789135757.903796:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655488:12345-0@lo:501: Request processed in 191us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.903805:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135757.903950:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655488:0@lo:501: 00000100:00100000:2.0:1789135757.903995:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655616:0@lo:503: 00000100:00100000:2.0:1789135757.904042:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.904075:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c1086240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.904239:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655616 00000100:00100000:3.0:1789135757.904243:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655616 00000100:00100000:3.0:1789135757.904276:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789135757.904283:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655616:12345-0@lo:503: 00000100:00100000:3.0:1789135757.904359:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655616:12345-0@lo:503: Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.904366:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789135757.904437:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655616:0@lo:503: 00000040:00080000:2.0:1789135757.904667:0:8423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789135757.904733:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655744:0@lo:502: 00000100:00100000:2.0:1789135757.905590:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.905717:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655744 00000100:00100000:3.0:1789135757.905724:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655744 00000100:00100000:3.0:1789135757.905766:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789135757.905774:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655744:12345-0@lo:502: 00000100:00100000:3.0:1789135757.905887:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655744:12345-0@lo:502: Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.905895:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789135757.905977:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c1086240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135757.905994:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655744:0@lo:502: 00000040:00080000:2.0:1789135757.906318:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789135757.906352:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789135757.906364:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789135757.906375:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789135757.906387:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789135757.906398:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789135757.906408:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789135757.906420:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789135757.906431:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789135757.906442:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789135757.906453:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789135757.906464:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789135757.906475:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789135757.906486:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789135757.906497:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789135757.906507:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789135757.906528:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789135757.906542:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789135757.906554:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789135757.906563:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789135757.906573:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789135757.906581:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789135757.906591:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789135757.906604:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789135757.906615:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789135757.907200:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789135757.907224:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789135757.907237:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789135757.907249:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789135757.907261:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789135757.907273:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789135757.907285:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789135757.907309:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789135757.907323:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789135757.907343:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789135757.907355:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789135757.907368:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789135757.907403:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655872:0@lo:502: 00000100:00100000:2.0:1789135757.907457:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.907491:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c1086240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.909274:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666655872 00000100:00100000:3.0:1789135757.909284:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666655872 00000100:00100000:3.0:1789135757.909342:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789135757.909359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655872:12345-0@lo:502: 00000100:00100000:3.0:1789135757.909498:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666655872:12345-0@lo:502: Request processed in 141us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.909506:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789135757.909603:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666655872:0@lo:502: 00000040:00080000:2.0:1789135757.909672:0:8423:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789135757.909684:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789135757.910575:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789135757.910589:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a7d1848000) 00000020:00000080:2.0:1789135757.910610:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789135757.910711:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7e761a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789135757.910715:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7e761a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789135757.910718:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7e761a000 3 00010000:00080000:2.0:1789135757.910750:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2a0f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789135757.913703:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789135757.913930:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789135757.913974:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789135757.913985:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x559c8745c6de277d 00000100:00080000:2.0:1789135757.913995:0:8452:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135757.914001:0:8452:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a6c2a0f000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789135757.914037:0:8452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f660a1c0 x1876044666656000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135757.914057:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789135757.914199:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666656000:0@lo:38: 00000100:00100000:3.0:1789135757.914267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.914327:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656000 00000100:00100000:3.0:1789135757.914332:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656000 00000100:00100000:3.0:1789135757.914362:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135757.914368:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666656000:12345-0@lo:38: 00010000:00080000:3.0:1789135757.914392:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1789135757.914423:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x559c8745c6de2784 00000004:00100000:3.0:1789135757.914437:0:6517:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789135757.914465:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135757.914513:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876044666656000:12345-0@lo:38: Request processed in 143us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.914521:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135757.914547:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666656128:0@lo:400: 00000100:00100000:3.0:1789135757.914576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.914606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656128 00000100:00100000:3.0:1789135757.914609:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656128 00000100:00100000:3.0:1789135757.914639:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789135757.914646:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666656128:12345-0@lo:400: 00000100:00100000:3.0:1789135757.914681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666656128:12345-0@lo:400: Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.914687:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789135757.914732:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f660b480 x1876044666656128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135757.914745:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666656128:0@lo:400: 00010000:00080000:3.0:1789135757.914769:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f660a1c0 x1876044666656000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135757.914777:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789135757.914783:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789135757.914790:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789135757.914794:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789135757.914797:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789135757.914802:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666656000:0@lo:38: 00000100:00100000:2.0:1789135757.914939:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666656512:0@lo:400: 00000100:00100000:2.0:1789135757.914969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.914997:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666656384:0@lo:400: 00000100:00100000:2.0:1789135757.915030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135757.915047:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135757.915052:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666656256:0@lo:400: 00000100:00100000:2.0:1789135757.915073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.916902:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656512 00000100:00100000:3.0:1789135757.916914:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656512 00000100:00100000:3.0:1789135757.916960:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656256 00000100:00100000:3.0:1789135757.916963:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656256 00000100:00100000:3.0:1789135757.916982:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789135757.916990:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666656512:12345-0@lo:400: 00000100:00100000:3.0:1789135757.917067:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666656512:12345-0@lo:400: Request processed in 78us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.917074:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789135757.917088:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135757.917094:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666656256:12345-0@lo:400: 00000100:00100000:3.0:1789135757.917137:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666656256:12345-0@lo:400: Request processed in 43us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.917142:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135757.917187:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666656512:0@lo:400: 00000100:00100000:3.0:1789135757.917228:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666656256:0@lo:400: 00000100:00100000:3.0:1789135757.917246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656384 00000100:00100000:3.0:1789135757.917250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656384 00000100:00100000:3.0:1789135757.917276:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135757.917282:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666656384:12345-0@lo:400: 00000100:00100000:3.0:1789135757.917317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666656384:12345-0@lo:400: Request processed in 35us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.917323:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789135757.917355:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f660a580 x1876044666656384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135757.917366:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666656384:0@lo:400: 00000020:01000004:2.0:1789135757.922962:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789135757.922992:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90a6c2b93490) 00000020:00000080:2.0:1789135757.923016:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789135757.923229:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7e761a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789135757.923234:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7e761a000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789135757.923236:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7e761a000 3 00010000:00080000:2.0:1789135757.923265:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2a0e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789135757.928216:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1789135757.928501:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789135757.928549:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789135757.928561:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x559c8745c6de2792 00000100:00080000:2.0:1789135757.928572:0:8452:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135757.928578:0:8452:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90a6c2a0e800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789135757.928612:0:8452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f660b480 x1876044666656640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135757.928645:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1789135757.928820:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789135757.929291:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666656640:0@lo:38: 00000100:00100000:3.0:1789135757.929366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789135757.929426:0:8423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789135757.929465:0:8423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135757.929488:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.929499:0:8423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789135757.929551:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789135757.929554:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135757.929555:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135757.929556:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135757.929557:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135757.929559:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135757.929561:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135757.929567:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135757.929568:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135757.929570:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135757.929571:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135757.929575:0:8423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789135757.929578:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789135757.929579:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789135757.929580:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135757.929581:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135757.929581:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135757.929582:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135757.929583:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135757.929585:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135757.929586:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135757.929587:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135757.929588:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789135757.929607:0:8423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789135757.929629:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666656768:0@lo:253: 00000100:00100000:3.0:1789135757.929667:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.929685:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.929706:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656768 00000100:00100000:3.0:1789135757.929713:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656768 00000100:00100000:3.0:1789135757.929760:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789135757.929769:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666656768:12345-0@lo:253: 20000000:01000000:3.0:1789135757.929801:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789135757.929816:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789135757.930063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656640 00000100:00100000:0.0:1789135757.930069:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656640 00000100:00100000:0.0:1789135757.930109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789135757.930115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666656640:12345-0@lo:38: 00010000:00080000:0.0:1789135757.930135:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:0.0:1789135757.930167:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x559c8745c6de2799 00000004:00100000:0.0:1789135757.930183:0:6515:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135757.930216:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90a8018d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135757.930263:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876044666656640:12345-0@lo:38: Request processed in 147us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135757.930277:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789135757.930482:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f660b480 x1876044666656640/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135757.930492:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789135757.930500:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789135757.930506:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789135757.930510:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789135757.930512:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789135757.930525:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666656640:0@lo:38: 20000000:01000000:3.0:1789135757.937603:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789135757.937632:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789135757.937978:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:8423:x1876044666656768:12345-0@lo:253: Request processed in 8203us (8304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.937989:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 20000000:01000000:1.0:1789135757.938070:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789135757.938075:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789135757.938103:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.938121:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de268f expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.938130:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26ab expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.938138:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.938187:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de26ab expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.938202:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de26ab expref: 15 pid: 6508 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.938215:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666656896:0@lo:104: 00000100:00100000:1.0:1789135757.938259:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135757.938317:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de268f expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135757.938326:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de268f expref: 15 pid: 6509 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135757.938334:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666657024:0@lo:104: 00000100:00100000:1.0:1789135757.938353:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135757.938452:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789135757.938472:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.938500:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666656896 00000100:00100000:3.0:1789135757.938506:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666656896 00000100:00100000:3.0:1789135757.938535:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657024 00000100:00100000:3.0:1789135757.938537:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657024 00000100:00100000:3.0:1789135757.938548:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135757.938555:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6416050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6531:x1876044666656896:12345-0@lo:104: 00010000:00010000:3.0:1789135757.938567:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938607:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789135757.938613:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6416050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6531:x1876044666656896:12345-0@lo:104: Request processed in 58us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.938619:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135757.938733:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135757.938740:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666657024:12345-0@lo:104: 00010000:00010000:3.0:1789135757.938748:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938780:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789135757.938785:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666657024:12345-0@lo:104: Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.938799:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789135757.938814:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789135757.938820:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938827:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789135757.938831:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938840:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135757.938847:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135757.938883:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789135757.938911:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938917:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135757.938932:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938939:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0030800/0x559c8745c6de26ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938953:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135757.938956:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938972:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789135757.938975:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.938981:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135757.938987:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135757.938993:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789135757.939018:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.939024:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135757.939036:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.939043:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de268f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2696 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.939055:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135757.939057:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135757.939058:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135757.939064:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135757.939080:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666657152:0@lo:103: 00000100:00100000:0.0:1789135757.939219:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:8423:1876044666656768:0@lo:253: 10000000:01000000:0.0:1789135757.939231:0:8423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789135757.939234:0:8423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135757.939236:0:8423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789135757.939237:0:8423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135757.939239:0:8423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135757.939240:0:8423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135757.939241:0:8423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135757.939243:0:8423:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135757.939244:0:8423:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135757.939246:0:8423:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135757.939247:0:8423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135757.939248:0:8423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789135757.939263:0:8423:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789135757.940212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.940290:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666657280:0@lo:103: 00000100:00100000:3.0:1789135757.940335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135757.940375:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657152 00000100:00100000:3.0:1789135757.940382:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657152 00010000:00010000:3.0:1789135757.940406:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26ab expref: 16 pid: 6508 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.940431:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657280 00000100:00100000:3.0:1789135757.940434:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657280 00010000:00010000:3.0:1789135757.940444:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de268f expref: 17 pid: 6509 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.940461:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135757.940468:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3639:x1876044666657152:12345-0@lo:103: 00010000:00010000:3.0:1789135757.940480:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135757.940487:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26ab expref: 17 pid: 6508 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.940499:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de26ab expref: 17 pid: 6508 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.940519:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135757.940548:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3639:x1876044666657152:12345-0@lo:103: Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.940556:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135757.940571:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135757.940576:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3640:x1876044666657280:12345-0@lo:103: 00010000:00010000:3.0:1789135757.940583:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135757.940588:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de268f expref: 16 pid: 6509 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.940605:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de268f expref: 16 pid: 6509 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.940619:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941647:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789135757.941665:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005572973s 00010000:00010000:3.0:1789135757.941670:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941677:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941683:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941690:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941697:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135757.941701:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941710:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941722:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941742:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135757.941794:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3640:x1876044666657280:12345-0@lo:103: Request processed in 1216us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135757.941803:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135757.941886:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666657280:0@lo:103: 00000100:00100000:3.0:1789135757.941916:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666657152:0@lo:103: 00010000:00010000:3.0:1789135757.941941:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de26b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de26ab expref: 15 pid: 6508 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.941951:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666656896:0@lo:104: 00010000:00010000:3.0:1789135757.941960:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2696 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de268f expref: 14 pid: 6509 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135757.941970:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666657024:0@lo:104: 00010000:00010000:3.0:1789135757.941987:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.941996:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.942002:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135757.942008:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879000/0x559c8745c6de27a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789135757.946361:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789135757.946540:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789135757.947184:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789135757.947361:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789135757.947584:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789135757.950179:0:8423:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789135757.952283:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789135757.961439:0:8423:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789135757.961449:0:8423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789135757.961493:0:8423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789135757.961533:0:8423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789135757.961556:0:8423:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789135757.961579:0:8423:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789135757.962537:0:8423:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789135757.962988:0:8423:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789135758.504069:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135758.696892:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666657408:0@lo:41: 00000100:00100000:3.0:1789135758.696992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135758.697761:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657408 00000100:00100000:1.0:1789135758.697770:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657408 00000100:00100000:1.0:1789135758.697833:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789135758.697843:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666657408:12345-0@lo:41: 00000004:00000024:1.0:1789135758.697913:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789135758.697976:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666657408:12345-0@lo:41: Request processed in 134us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135758.697982:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135758.698099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666657408:0@lo:41: 00000020:00000004:3.0:1789135758.827936:0:8509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135758.828206:0:8509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789135759.159395:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789135759.159404:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7fa5f7000 from 30 10000000:01000000:0.0:1789135759.159422:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135759.159467:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.159479:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.159491:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135759.159514:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2311a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666657536:0@lo:101: 00000100:00100000:0.0:1789135759.159580:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.159639:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d18296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.159747:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657536 00000100:00100000:1.0:1789135759.159755:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657536 00000100:00100000:1.0:1789135759.159802:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135759.159819:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:6513:x1876044666657536:12345-0@lo:101: 00010000:00010000:1.0:1789135759.159830:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135759.159866:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de27a7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.159893:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.159905:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.159914:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878200, rc 0) 00000100:00100000:1.0:1789135759.159954:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666657536:12345-0@lo:101: Request processed in 137us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.159961:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135759.160008:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2311a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666657536:0@lo:101: 00010000:00010000:1.0:1789135759.160023:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.160032:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135759.160482:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666657664:0@lo:501: 00000100:00100000:1.0:1789135759.160513:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.160543:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135759.160585:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657664 00000100:00100000:3.0:1789135759.160590:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657664 00000100:00100000:3.0:1789135759.160624:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789135759.160631:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666657664:12345-0@lo:501: 00000100:00100000:3.0:1789135759.160748:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666657664:12345-0@lo:501: Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.160755:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135759.161346:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666657664:0@lo:501: 00000100:00100000:1.0:1789135759.161383:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666657792:0@lo:503: 00000100:00100000:1.0:1789135759.161438:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.161464:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.161506:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657792 00000100:00100000:0.0:1789135759.161510:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657792 00000100:00100000:0.0:1789135759.161546:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789135759.161553:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666657792:12345-0@lo:503: 00000100:00100000:0.0:1789135759.161633:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666657792:12345-0@lo:503: Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.161640:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789135759.161769:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666657792:0@lo:503: 00000100:00100000:1.0:1789135759.163386:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8528:1876044666657920:0@lo:502: 00000100:00100000:1.0:1789135759.163456:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.163503:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.163599:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666657920 00000100:00100000:0.0:1789135759.163606:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666657920 00000100:00100000:0.0:1789135759.163649:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789135759.163658:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8528:x1876044666657920:12345-0@lo:502: 00000100:00100000:0.0:1789135759.163770:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8528:x1876044666657920:12345-0@lo:502: Request processed in 112us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.163777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789135759.163927:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8528:1876044666657920:0@lo:502: 00000100:00100000:1.0:1789135759.163972:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8528:1876044666658048:0@lo:502: 00000100:00100000:1.0:1789135759.164006:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.164031:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135759.164179:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658048 00000100:00100000:3.0:1789135759.164184:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658048 00000100:00100000:3.0:1789135759.164214:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135759.164220:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8528:x1876044666658048:12345-0@lo:502: 00000100:00100000:3.0:1789135759.164369:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:8528:x1876044666658048:12345-0@lo:502: Request processed in 149us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.164377:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789135759.164536:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8528:1876044666658048:0@lo:502: 00000040:00080000:1.0:1789135759.164556:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789135759.167883:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789135759.167918:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135759.167937:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.167949:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135759.167959:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789135759.167962:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa5f7000 from 5 10000000:01000000:0.0:1789135759.167965:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789135759.168008:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.168016:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.168027:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135759.168051:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2310780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658176:0@lo:101: 00000100:00100000:0.0:1789135759.168136:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.168179:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1829840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.168329:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658176 00000100:00100000:1.0:1789135759.168338:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658176 00000100:00100000:1.0:1789135759.168397:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789135759.168408:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666658176:12345-0@lo:101: 00010000:00010000:1.0:1789135759.168423:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135759.168439:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de27b5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.168467:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.168479:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.168488:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135759.168533:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666658176:12345-0@lo:101: Request processed in 127us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.168540:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789135759.168691:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2310780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658176:0@lo:101: 00010000:00010000:0.0:1789135759.168705:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.168712:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135759.168760:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2310780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658304:0@lo:256: 00000100:00100000:0.0:1789135759.168800:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.168823:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1829840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.168891:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658304 00000100:00100000:1.0:1789135759.168896:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658304 00000100:00100000:1.0:1789135759.168923:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789135759.168929:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666658304:12345-0@lo:256: 20000000:01000000:1.0:1789135759.168942:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789135759.168960:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789135759.168963:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789135759.169032:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666658304:12345-0@lo:256: Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.169039:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789135759.169125:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2310780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658304:0@lo:256: 10000000:01000000:0.0:1789135759.169168:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789135759.169174:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.169182:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135759.169190:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789135759.169192:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1789135759.169195:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789135759.169212:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.169219:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.169227:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135759.169238:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2310780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658432:0@lo:101: 00000100:00100000:0.0:1789135759.169264:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.169836:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1829840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.170493:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658432 00000100:00100000:1.0:1789135759.170501:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658432 00000100:00100000:1.0:1789135759.170582:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789135759.170594:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666658432:12345-0@lo:101: 00010000:00010000:1.0:1789135759.170607:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135759.170620:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de27c3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.170645:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.170656:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.170664:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878600, rc 0) 00000100:00100000:1.0:1789135759.170720:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666658432:12345-0@lo:101: Request processed in 129us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.170738:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789135759.170808:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2310780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658432:0@lo:101: 00010000:00010000:2.0:1789135759.170822:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135759.170830:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135759.170953:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658560:0@lo:501: 00000100:00100000:2.0:1789135759.170983:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.171284:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.171408:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658560 00000100:00100000:0.0:1789135759.171414:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658560 00000100:00100000:0.0:1789135759.171440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789135759.171447:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666658560:12345-0@lo:501: 00000100:00100000:0.0:1789135759.171575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666658560:12345-0@lo:501: Request processed in 128us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.171582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789135759.171639:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658560:0@lo:501: 00000100:00100000:2.0:1789135759.171669:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658688:0@lo:503: 00000100:00100000:2.0:1789135759.171707:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.171727:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.171765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658688 00000100:00100000:0.0:1789135759.171770:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658688 00000100:00100000:0.0:1789135759.171788:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789135759.171793:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666658688:12345-0@lo:503: 00000100:00100000:0.0:1789135759.171905:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666658688:12345-0@lo:503: Request processed in 111us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.171912:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789135759.171990:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666658688:0@lo:503: 00000100:00100000:2.0:1789135759.172466:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8529:1876044666658816:0@lo:502: 00000100:00100000:2.0:1789135759.172502:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.172534:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.172576:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658816 00000100:00100000:0.0:1789135759.172579:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658816 00000100:00100000:0.0:1789135759.172628:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789135759.172634:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8529:x1876044666658816:12345-0@lo:502: 00000100:00100000:0.0:1789135759.172716:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8529:x1876044666658816:12345-0@lo:502: Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.172723:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789135759.172781:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8529:1876044666658816:0@lo:502: 00000020:01000000:2.0:1789135759.172802:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789135759.172809:0:8529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789135759.172815:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135759.172817:0:8529:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789135759.172821:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789135759.172825:0:8529:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:2.0:1789135759.172872:0:8529:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789135759.172875:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789135759.172889:0:8529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90a6c2b94ed8) 00000020:00000080:2.0:1789135759.172909:0:8529:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1789135759.172913:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789135759.172994:0:8529:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789135759.173001:0:8529:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789135759.173013:0:8529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de27d8 00010000:00080000:2.0:1789135759.173041:0:8529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2291800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789135759.173261:0:8529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789135759.184900:0:8529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789135759.184925:0:8529:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789135759.185131:0:8529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135759.185344:0:8529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135759.185447:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789135759.185521:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789135759.186485:0:8530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135759.186490:0:8530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789135759.187579:0:8529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789135759.187595:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789135759.187633:0:8529:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789135759.187658:0:8529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de27df 00000100:00080000:0.0:1789135759.187669:0:8529:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789135759.187675:0:8529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a6c2291800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789135759.187715:0:8529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c2313c00 x1876044666658944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789135759.187794:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666658944:0@lo:8: 00000100:00100000:3.0:1789135759.187914:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135759.188082:0:8529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789135759.188184:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135759.188198:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135759.188201:0:8529:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789135759.188205:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135759.188208:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135759.188210:0:8529:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789135759.188213:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789135759.188215:0:8529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789135759.188242:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8529:1876044666659072:0@lo:502: 00000100:00100000:0.0:1789135759.188305:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.188323:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1829000 going to sleep for 11 seconds 00000100:00100000:2.0:1789135759.188507:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666658944 00000100:00100000:2.0:1789135759.188514:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666658944 00000100:00100000:2.0:1789135759.188556:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135759.188564:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1876044666658944:12345-0@lo:8: 00010000:00080000:2.0:1789135759.188592:0:8429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1789135759.188616:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de27e6 00002000:00100000:2.0:1789135759.188652:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90a6c2292000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789135759.188657:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1789135759.188660:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789135759.188729:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789135759.188981:0:8429:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789135759.189006:0:8429:0:(import.c:65:import_set_state_nolock()) ffff90a6c2297000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135759.189257:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666659328:0@lo:400: 00000100:00100000:1.0:1789135759.189300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.189321:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666659840:0@lo:400: 00000100:00100000:1.0:1789135759.189344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.189361:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789135759.189365:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666659200:0@lo:400: 00000100:00100000:1.0:1789135759.189381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.189395:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666659712:0@lo:400: 00000100:00100000:1.0:1789135759.189423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.189444:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666659456:0@lo:400: 00000100:00100000:1.0:1789135759.189461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.189475:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135759.189479:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666659584:0@lo:400: 00000100:00100000:1.0:1789135759.189495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.189520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659328 00000100:00100000:1.0:1789135759.189524:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659328 00000100:00100000:1.0:1789135759.189552:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659584 00000100:00100000:1.0:1789135759.189554:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659584 00000100:00100000:1.0:1789135759.189565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135759.189570:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666659328:12345-0@lo:400: 00000100:00100000:1.0:1789135759.189607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666659328:12345-0@lo:400: Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.189613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789135759.189629:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135759.189634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666659584:12345-0@lo:400: 00000100:00100000:1.0:1789135759.189676:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666659584:12345-0@lo:400: Request processed in 41us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.189682:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135759.189701:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659840 00000100:00100000:1.0:1789135759.189705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659840 00000100:00100000:1.0:1789135759.189735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659200 00000100:00100000:1.0:1789135759.189739:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659200 00000100:00100000:1.0:1789135759.189749:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659712 00000100:00100000:1.0:1789135759.189751:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659712 00000100:00100000:1.0:1789135759.189761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659456 00000100:00100000:1.0:1789135759.189763:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659456 00000100:00100000:1.0:1789135759.189775:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789135759.189780:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666659840:12345-0@lo:400: 00000100:00100000:1.0:1789135759.189813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666659840:12345-0@lo:400: Request processed in 33us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.189819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789135759.189831:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789135759.189836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666659200:12345-0@lo:400: 00000100:00100000:1.0:1789135759.189904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666659200:12345-0@lo:400: Request processed in 67us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.189910:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789135759.189923:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135759.189928:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666659712:12345-0@lo:400: 00000100:00100000:1.0:1789135759.189952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666659712:12345-0@lo:400: Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.189957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135759.189967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135759.189972:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666659456:12345-0@lo:400: 00000100:00100000:1.0:1789135759.190005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666659456:12345-0@lo:400: Request processed in 33us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.190010:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789135759.190044:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135759.190048:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135759.190075:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666659584:0@lo:400: 00010000:00080000:1.0:1789135759.190088:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55acf00 x1876044666659456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135759.190097:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666659456:0@lo:400: 00010000:00080000:1.0:1789135759.190132:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55ad680 x1876044666659200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135759.190141:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666659200:0@lo:400: 00010000:00080000:1.0:1789135759.190150:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55af840 x1876044666659712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135759.190158:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666659712:0@lo:400: 00000100:00100000:1.0:1789135759.190167:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666659328:0@lo:400: 00010000:00080000:1.0:1789135759.190175:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55aed00 x1876044666659840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135759.190182:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666659840:0@lo:400: 00000100:00100000:1.0:1789135759.190213:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659072 00000100:00100000:1.0:1789135759.190216:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659072 00000100:00100000:1.0:1789135759.190244:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789135759.190251:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8529:x1876044666659072:12345-0@lo:502: 00000100:00100000:1.0:1789135759.190361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:8529:x1876044666659072:12345-0@lo:502: Request processed in 111us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.190368:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789135759.190580:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8529:1876044666659072:0@lo:502: 00000020:01000000:0.0:1789135759.190604:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135759.190611:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135759.190613:0:8529:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789135759.190618:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1789135759.191182:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789135759.191207:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789135759.191216:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.191226:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135759.191235:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135759.191238:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7d26b4800 from 30 10000000:01000000:1.0:1789135759.191241:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135759.191281:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.191290:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.191299:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135759.191319:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666659968:0@lo:101: 00000100:00100000:1.0:1789135759.191371:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.191496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666659968 00000100:00100000:0.0:1789135759.191500:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666659968 00000100:00100000:0.0:1789135759.191534:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135759.191543:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666659968:12345-0@lo:101: 00010000:00010000:0.0:1789135759.191552:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135759.191564:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de27ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.191585:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de27ed expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.191595:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27ed expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.191603:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031a00, rc 0) 00000100:00100000:0.0:1789135759.191640:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666659968:12345-0@lo:101: Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.191646:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789135759.191758:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.191777:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666659968:0@lo:101: 00010000:00010000:1.0:1789135759.191789:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.191809:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135759.191903:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660096:0@lo:501: 00000100:00100000:1.0:1789135759.191929:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.191947:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.192003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660096 00000100:00100000:0.0:1789135759.192007:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660096 00000100:00100000:0.0:1789135759.192034:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789135759.192040:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666660096:12345-0@lo:501: 00000100:00100000:0.0:1789135759.192136:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666660096:12345-0@lo:501: Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.192142:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789135759.192196:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660096:0@lo:501: 00000100:00100000:1.0:1789135759.192221:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660224:0@lo:503: 00000100:00100000:1.0:1789135759.192252:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.192343:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660224 00000100:00100000:0.0:1789135759.192347:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660224 00000100:00100000:0.0:1789135759.192368:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789135759.192373:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666660224:12345-0@lo:503: 00000100:00100000:0.0:1789135759.192457:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666660224:12345-0@lo:503: Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.192464:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789135759.192578:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.192593:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660224:0@lo:503: 00000100:00100000:2.0:1789135759.192891:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666658944:12345-0@lo:8: Request processed in 4325us (4975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135759.192901:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135759.193083:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8532:1876044666660352:0@lo:502: 00000100:00100000:1.0:1789135759.193125:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.193160:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.193201:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660352 00000100:00100000:0.0:1789135759.193206:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660352 00000100:00100000:0.0:1789135759.193240:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789135759.193248:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8532:x1876044666660352:12345-0@lo:502: 00000100:00100000:0.0:1789135759.193473:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8532:x1876044666660352:12345-0@lo:502: Request processed in 225us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.193480:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135759.193592:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8532:1876044666660352:0@lo:502: 00000100:00100000:2.0:1789135759.193637:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8532:1876044666660480:0@lo:502: 00000100:00100000:2.0:1789135759.193675:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.193696:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.193742:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660480 00000100:00100000:0.0:1789135759.193746:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660480 00000100:00100000:0.0:1789135759.193775:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789135759.193782:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8532:x1876044666660480:12345-0@lo:502: 00000100:00100000:0.0:1789135759.193887:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:8532:x1876044666660480:12345-0@lo:502: Request processed in 105us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.193894:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135759.194016:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8532:1876044666660480:0@lo:502: 00000040:00080000:2.0:1789135759.194037:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789135759.194173:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789135759.194192:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135759.194200:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.194209:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135759.194217:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789135759.194220:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d26b4800 from 5 10000000:01000000:1.0:1789135759.194222:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789135759.194244:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.194257:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.194266:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135759.194350:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660608:0@lo:101: 00000100:00100000:1.0:1789135759.194377:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.194473:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135759.194545:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660608 00000100:00100000:2.0:1789135759.194549:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660608 00000100:00100000:2.0:1789135759.194583:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789135759.194589:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666660608:12345-0@lo:101: 00010000:00010000:2.0:1789135759.194597:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135759.194609:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de27fb expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135759.194628:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de27fb expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135759.194638:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27fb expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135759.194647:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fc00, rc 0) 00000100:00100000:2.0:1789135759.194685:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666660608:12345-0@lo:101: Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135759.194692:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789135759.194772:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660608:0@lo:101: 00010000:00010000:1.0:1789135759.194785:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.194794:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135759.194849:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660736:0@lo:256: 00000100:00100000:1.0:1789135759.194912:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.194934:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.194981:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660736 00000100:00100000:0.0:1789135759.194986:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660736 00000100:00100000:0.0:1789135759.195007:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789135759.195012:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666660736:12345-0@lo:256: 20000000:01000000:0.0:1789135759.195025:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789135759.195043:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789135759.195046:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789135759.195130:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666660736:12345-0@lo:256: Request processed in 116us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.195137:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135759.195242:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660736:0@lo:256: 10000000:01000000:1.0:1789135759.195358:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789135759.195364:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.195371:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135759.195387:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789135759.195389:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789135759.195392:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789135759.195483:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.195490:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135759.195497:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135759.195508:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660864:0@lo:101: 00000100:00100000:1.0:1789135759.195532:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.195581:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.195617:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660864 00000100:00100000:0.0:1789135759.195621:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660864 00000100:00100000:0.0:1789135759.195650:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789135759.195657:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666660864:12345-0@lo:101: 00010000:00010000:0.0:1789135759.195665:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135759.195674:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2809 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.195689:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2809 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.195698:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2809 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135759.195705:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031800, rc 0) 00010000:00080000:3.0:1789135759.195828:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2313c00 x1876044666658944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135759.195849:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789135759.195871:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789135759.195880:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789135759.195886:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789135759.195889:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2291800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789135759.195907:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789135759.195921:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666658944:0@lo:8: 00000100:00100000:0.0:1789135759.196044:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666660864:12345-0@lo:101: Request processed in 386us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.196051:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135759.196147:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666660992:0@lo:700: 00000100:00100000:3.0:1789135759.196177:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135759.196200:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.196249:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666660992 00000100:00100000:1.0:1789135759.196253:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666660992 00000100:00100000:1.0:1789135759.196305:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789135759.196311:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8531:x1876044666660992:12345-0@lo:700: 00000100:00100000:1.0:1789135759.196338:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1876044666661120:0@lo:700: 00000100:00100000:1.0:1789135759.196363:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.196380:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa180 going to sleep for 11 seconds 00000100:00080000:3.0:1789135759.196551:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135759.196576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661120 00000100:00100000:1.0:1789135759.196580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661120 00000100:00100000:1.0:1789135759.196612:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135759.196618:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1876044666661120:12345-0@lo:700: 00000100:00100000:2.0:1789135759.196808:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666660864:0@lo:101: 00010000:00010000:2.0:1789135759.196825:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135759.196834:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135759.196905:0:8530:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789135759.196968:0:8530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 207316112603ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789135759.196974:0:8530:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789135759.197574:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666661248:0@lo:501: 00000100:00100000:2.0:1789135759.197613:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.197683:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.198062:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661248 00000100:00100000:1.0:1789135759.198131:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661248 00000100:00100000:1.0:1789135759.198204:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789135759.198213:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666661248:12345-0@lo:501: 00000100:00100000:1.0:1789135759.198708:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666661248:12345-0@lo:501: Request processed in 494us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.198717:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:0.0:1789135759.199412:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789135759.199584:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666661248:0@lo:501: 00000100:00100000:3.0:1789135759.199635:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666661376:0@lo:503: 00000100:00100000:3.0:1789135759.199691:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135759.199734:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f68863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.199791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661376 00000100:00100000:0.0:1789135759.199797:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661376 00000100:00100000:0.0:1789135759.199893:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789135759.199902:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666661376:12345-0@lo:503: 00000100:00100000:0.0:1789135759.200004:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666661376:12345-0@lo:503: Request processed in 103us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.200011:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789135759.200232:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666661376:0@lo:503: 00000100:00100000:1.0:1789135759.200740:0:8533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8533:1876044666661504:0@lo:502: 00000100:00100000:1.0:1789135759.200782:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.200817:0:8533:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.200895:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661504 00000100:00100000:0.0:1789135759.200900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661504 00000100:00100000:0.0:1789135759.200924:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789135759.200930:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:8533:x1876044666661504:12345-0@lo:502: 00000100:00100000:0.0:1789135759.201031:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:8533:x1876044666661504:12345-0@lo:502: Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.201039:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789135759.201207:0:8533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8533:1876044666661504:0@lo:502: 00000020:01000000:3.0:1789135759.201235:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789135759.201242:0:8533:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789135759.201250:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135759.201252:0:8533:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789135759.201260:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789135759.201264:0:8533:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:3.0:1789135759.201367:0:8533:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789135759.201372:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789135759.201386:0:8533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a7f64b3490) 00000020:00000080:3.0:1789135759.201480:0:8533:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789135759.201488:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789135759.201562:0:8533:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789135759.201568:0:8533:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789135759.201574:0:8533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de281e 00010000:00080000:3.0:1789135759.201604:0:8533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c228c000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789135759.202917:0:8533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1789135759.203493:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1789135759.210002:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1876044666661120:12345-0@lo:700: Request processed in 13373us (13627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.210018:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789135759.210085:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55af840 x1876044666661120/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135759.210103:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1876044666661120:0@lo:700: 40000000:02000000:1.0:1789135759.210119:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1789135759.214233:0:8533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789135759.214261:0:8533:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789135759.215234:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135759.215619:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135759.215707:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789135759.215804:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:2.0:1789135759.220158:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:2.0:1789135759.220551:0:8534:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135759.220557:0:8534:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789135759.222144:0:8533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789135759.222158:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789135759.222197:0:8533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789135759.222224:0:8533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de2825 00000100:00080000:2.0:1789135759.222237:0:8533:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789135759.222243:0:8533:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789135759.222290:0:8533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f6608780 x1876044666661632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789135759.222312:0:8533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789135759.222370:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135759.222375:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135759.222377:0:8533:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789135759.222380:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135759.222383:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135759.222385:0:8533:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789135759.222388:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789135759.222390:0:8533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789135759.222492:0:8533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8533:1876044666661760:0@lo:502: 00000100:00100000:2.0:1789135759.222575:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.222620:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661760 00000100:00100000:2.0:1789135759.222627:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661760 00000100:00100000:2.0:1789135759.222674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789135759.222682:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:8533:x1876044666661760:12345-0@lo:502: 00000100:00100000:2.0:1789135759.222791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:8533:x1876044666661760:12345-0@lo:502: Request processed in 108us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135759.222799:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789135759.222893:0:8533:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135759.222915:0:8533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:8533:1876044666661760:0@lo:502: 00000020:01000000:2.0:1789135759.222942:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135759.222947:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135759.222948:0:8533:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789135759.222953:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1789135759.223565:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8531:x1876044666660992:12345-0@lo:700: Request processed in 27251us (27384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.223576:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789135759.223693:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6b00b40 x1876044666660992/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135759.223707:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666660992:0@lo:700: 00000100:00100000:0.0:1789135759.223956:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666661632:0@lo:8: 00000100:00100000:0.0:1789135759.223997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.224111:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661632 00000100:00100000:1.0:1789135759.224117:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661632 00000100:00100000:1.0:1789135759.224148:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789135759.224153:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666661632:12345-0@lo:8: 00010000:00080000:1.0:1789135759.224177:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789135759.224204:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de282c 00002000:00100000:1.0:1789135759.224222:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a7ff501000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789135759.224227:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789135759.224229:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789135759.224374:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789135759.224464:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a7ff503800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789135759.224520:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666661632:12345-0@lo:8: Request processed in 365us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.224528:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789135759.224601:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6608780 x1876044666661632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135759.224611:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789135759.224618:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789135759.224626:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789135759.224632:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789135759.224634:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789135759.224655:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789135759.224660:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666661632:0@lo:8: 00000004:00080000:2.0:1789135759.224773:0:8534:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789135759.224828:0:8534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 207343973191ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789135759.224835:0:8534:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789135759.226697:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:01000000:3.0:1789135759.226997:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789135759.227036:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789135759.227048:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.227060:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135759.227070:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789135759.227078:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a7efa18000 from 1 10000000:01000000:3.0:1789135759.227081:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789135759.227116:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.227124:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.227135:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135759.227158:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666661888:0@lo:101: 00000100:00100000:3.0:1789135759.227221:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135759.227262:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:3.0:1789135759.227298:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666661888 00000100:00100000:3.0:1789135759.227304:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666661888 00000100:00100000:3.0:1789135759.227346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789135759.227354:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666661888:12345-0@lo:101: 00010000:00010000:3.0:1789135759.227366:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135759.227377:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2833 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.227724:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2833 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.227737:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2833 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.227745:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a8021dc400, rc 0) 00000100:00100000:3.0:1789135759.227794:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666661888:12345-0@lo:101: Request processed in 440us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.227801:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789135759.227960:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666661888:0@lo:101: 00010000:00010000:2.0:1789135759.227975:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135759.227984:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135759.228041:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666662016:0@lo:501: 00000100:00100000:2.0:1789135759.228068:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.228090:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135759.228138:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662016 00000100:00100000:3.0:1789135759.228142:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662016 00000100:00100000:3.0:1789135759.228171:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789135759.228177:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666662016:12345-0@lo:501: 00000100:00100000:3.0:1789135759.228251:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666662016:12345-0@lo:501: Request processed in 73us (181us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135759.228257:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789135759.228598:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666662016:0@lo:501: 10000000:01000000:3.0:1789135759.228638:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789135759.228644:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135759.228651:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135759.231913:0:8531:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789135759.231951:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666662272:0@lo:7: 00000100:00100000:2.0:1789135759.232023:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.232068:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135759.232095:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135759.232109:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666662144:0@lo:13: 00000100:00100000:2.0:1789135759.232137:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.232165:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662272 00000100:00100000:2.0:1789135759.232173:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662272 00000100:00100000:2.0:1789135759.232218:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135759.232227:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1876044666662272:12345-0@lo:7: 00000100:00100000:3.0:1789135759.233528:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662144 00000100:00100000:3.0:1789135759.233536:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662144 00000100:00100000:3.0:1789135759.233581:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789135759.233589:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876044666662144:12345-0@lo:13: 00002000:00000024:3.0:1789135759.233612:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:3.0:1789135759.233677:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876044666662144:12345-0@lo:13: Request processed in 89us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.233685:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789135759.233731:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f660a940 x1876044666662144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135759.233753:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666662144:0@lo:13: 00000004:00080000:1.0:1789135759.237242:0:8535:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789135759.237290:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666662528:0@lo:7: 00000100:00100000:1.0:1789135759.237362:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.238185:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789135759.238195:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789135759.239372:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135759.239492:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662528 00000100:00100000:1.0:1789135759.239502:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662528 00000100:00100000:1.0:1789135759.239639:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135759.239650:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8535:x1876044666662528:12345-0@lo:7: 00000100:00080000:0.0:1789135759.239904:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789135759.246775:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789135759.246783:0:8429:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789135759.246910:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1876044666662272:12345-0@lo:7: Request processed in 14680us (14883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135759.246923:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789135759.247503:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6608f00 x1876044666662272/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135759.247520:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666662272:0@lo:7: 00000004:00080000:0.0:1789135759.247535:0:8531:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789135759.247576:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666662656:0@lo:5: 00000100:00100000:0.0:1789135759.247613:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.247657:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135759.248218:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662656 00000100:00100000:2.0:1789135759.248230:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662656 00000100:00100000:2.0:1789135759.248268:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789135759.249177:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1876044666662656:12345-0@lo:5: 00002000:00080000:2.0:1789135759.249206:0:8430:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789135759.249259:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1876044666662656:12345-0@lo:5: Request processed in 89us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135759.249266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789135759.249514:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c23103c0 x1876044666662656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135759.249529:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666662656:0@lo:5: 00000004:00080000:0.0:1789135759.249540:0:8531:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789135759.249573:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666662784:0@lo:5: 00000100:00100000:0.0:1789135759.249599:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135759.249617:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135759.249678:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662784 00000100:00100000:2.0:1789135759.249683:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662784 00000100:00100000:2.0:1789135759.249702:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135759.249707:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1876044666662784:12345-0@lo:5: 00002000:00080000:2.0:1789135759.249727:0:8430:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789135759.256672:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135759.256702:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666662400:0@lo:13: 00000100:00100000:3.0:1789135759.256781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135759.256876:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662400 00000100:00100000:3.0:1789135759.256884:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662400 00000100:00100000:3.0:1789135759.256927:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135759.256936:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666662400:12345-0@lo:13: 00002000:00000024:3.0:1789135759.256960:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923738624 avail 3692216320 00000100:00100000:3.0:1789135759.257002:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666662400:12345-0@lo:13: Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.257009:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789135759.257055:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55af840 x1876044666662400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135759.257075:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666662400:0@lo:13: 00000100:00100000:2.0:1789135759.257909:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8531:x1876044666662784:12345-0@lo:5: Request processed in 8199us (8306us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789135759.257920:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789135759.258370:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c23103c0 x1876044666662784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135759.258389:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876044666662784:0@lo:5: 00000004:00080000:1.0:1789135759.258419:0:8531:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789135759.258463:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1876044666662912:0@lo:900: 00000100:00100000:1.0:1789135759.258502:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135759.258545:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135759.259997:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666662912 00000100:00100000:3.0:1789135759.260006:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666662912 00000100:00100000:3.0:1789135759.260103:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789135759.260113:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1876044666662912:12345-0@lo:900: 00000100:00100000:3.0:1789135759.260198:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1876044666662912:12345-0@lo:900: Request processed in 86us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135759.260205:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:0.0:1789135759.260666:0:8536:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789135759.260673:0:8536:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789135759.260730:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8535:x1876044666662528:12345-0@lo:7: Request processed in 21081us (23366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135759.260741:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789135759.260820:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55ae580 x1876044666662528/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135759.260835:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666662528:0@lo:7: 00000004:00080000:2.0:1789135759.260880:0:8535:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789135759.260920:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666663040:0@lo:5: 00000100:00100000:2.0:1789135759.260952:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.260989:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.261044:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663040 00000100:00100000:0.0:1789135759.261049:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663040 00000100:00100000:0.0:1789135759.261088:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135759.261095:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8535:x1876044666663040:12345-0@lo:5: 00002000:00080000:0.0:1789135759.261113:0:8430:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789135759.261116:0:8430:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1789135759.265213:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1789135759.265236:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789135759.265246:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1789135759.265659:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55acb40 x1876044666662912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135759.265679:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1876044666662912:0@lo:900: 00000100:00100000:0.0:1789135759.266366:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8535:x1876044666663040:12345-0@lo:5: Request processed in 5268us (5409us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789135759.266390:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789135759.266533:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6609a40 x1876044666663040/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135759.266557:0:8535:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789135759.266564:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666663040:0@lo:5: 00000004:00080000:2.0:1789135759.266575:0:8535:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789135759.266625:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666663168:0@lo:700: 00000100:00100000:2.0:1789135759.266663:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.266742:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135759.266810:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663168 00000100:00100000:0.0:1789135759.266817:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663168 00000100:00100000:0.0:1789135759.266989:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789135759.267000:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8535:x1876044666663168:12345-0@lo:700: 00000100:00100000:1.0:1789135759.280099:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8535:x1876044666663168:12345-0@lo:700: Request processed in 13092us (13425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135759.280123:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789135759.280253:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6609a40 x1876044666663168/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135759.280280:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666663168:0@lo:700: 00000004:02000040:2.0:1789135759.285129:0:8535:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1789135759.289996:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666663296:0@lo:5: 00000100:00100000:2.0:1789135759.290067:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135759.290238:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789135759.290349:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663296 00000100:00100000:3.0:1789135759.290356:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663296 00000100:00100000:3.0:1789135759.290499:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789135759.290508:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8535:x1876044666663296:12345-0@lo:5: 00002000:00080000:3.0:1789135759.299688:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789135759.299716:0:8429:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789135759.301313:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8535:x1876044666663296:12345-0@lo:5: Request processed in 10797us (11238us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789135759.301325:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789135759.301789:0:8535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f660a580 x1876044666663296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135775 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135759.301807:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8535:1876044666663296:0@lo:5: 00000004:00080000:2.0:1789135759.301824:0:8535:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1789135759.530531:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135760.231958:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135760.231984:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2312580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666663424:0@lo:41: 00000100:00100000:0.0:1789135760.232053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135760.232133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663424 00000100:00100000:0.0:1789135760.232140:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663424 00000100:00100000:0.0:1789135760.232188:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135760.232198:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666663424:12345-0@lo:41: 00000004:00000024:0.0:1789135760.232235:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789135760.232284:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666663424:12345-0@lo:41: Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135760.232291:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135760.232335:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2312580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666663424:0@lo:41: 00010000:00010000:3.0:1789135760.553183:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135761.584573:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135762.601062:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135763.628822:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135763.816979:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666663552:0@lo:41: 00000100:00100000:0.0:1789135763.817066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135763.817237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663552 00000100:00100000:1.0:1789135763.817246:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663552 00000100:00100000:1.0:1789135763.817298:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135763.817307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666663552:12345-0@lo:41: 00000004:00000024:1.0:1789135763.817342:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789135763.817392:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666663552:12345-0@lo:41: Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135763.817399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135763.821056:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666663552:0@lo:41: 00000001:02000400:0.0:1789135764.291280:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789135764.329002:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666663680:0@lo:400: 00000100:00100000:2.0:1789135764.329081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329178:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666664192:0@lo:400: 00000100:00100000:2.0:1789135764.329203:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329231:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666664704:0@lo:400: 00000100:00100000:2.0:1789135764.329252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329276:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135764.329291:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666663808:0@lo:400: 00000100:00100000:2.0:1789135764.329315:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329330:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666664320:0@lo:400: 00000100:00100000:2.0:1789135764.329353:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329380:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666663936:0@lo:400: 00000100:00100000:2.0:1789135764.329402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329418:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666664448:0@lo:400: 00000100:00100000:2.0:1789135764.329441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329456:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789135764.329462:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666664064:0@lo:400: 00000100:00100000:2.0:1789135764.329561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329579:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666664576:0@lo:400: 00000100:00100000:2.0:1789135764.329680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.329715:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664704 00000100:00100000:2.0:1789135764.329723:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664704 00000100:00100000:2.0:1789135764.329787:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664576 00000100:00100000:2.0:1789135764.329790:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664576 00000100:00100000:2.0:1789135764.329971:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135764.329982:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666664704:12345-0@lo:400: 00000100:00100000:2.0:1789135764.330038:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666664704:12345-0@lo:400: Request processed in 58us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135764.330046:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789135764.330063:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789135764.330069:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666664576:12345-0@lo:400: 00000100:00100000:2.0:1789135764.330102:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666664576:12345-0@lo:400: Request processed in 33us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135764.330107:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789135764.330136:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135764.330179:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da7c00 x1876044666664576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135764.330189:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789135764.330203:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666664576:0@lo:400: 00010000:00080000:2.0:1789135764.330224:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da61c0 x1876044666664704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135764.330234:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666664704:0@lo:400: 00000100:00100000:1.0:1789135764.330305:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664192 00000100:00100000:1.0:1789135764.330310:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664192 00000100:00100000:1.0:1789135764.330344:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663936 00000100:00100000:1.0:1789135764.330347:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663936 00000100:00100000:1.0:1789135764.330362:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135764.330367:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666664192:12345-0@lo:400: 00000100:00100000:1.0:1789135764.330408:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666664192:12345-0@lo:400: Request processed in 40us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.330415:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135764.330428:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135764.330435:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666663936:12345-0@lo:400: 00000100:00100000:1.0:1789135764.330468:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666663936:12345-0@lo:400: Request processed in 34us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.330474:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135764.330505:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663808 00000100:00100000:1.0:1789135764.330509:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663808 00000100:00100000:1.0:1789135764.330526:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664320 00000100:00100000:1.0:1789135764.330528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664320 00000100:00100000:1.0:1789135764.330557:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664448 00000100:00100000:1.0:1789135764.330560:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664448 00000100:00100000:1.0:1789135764.330573:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664064 00000100:00100000:1.0:1789135764.330576:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664064 00000100:00100000:1.0:1789135764.330588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135764.330606:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666663808:12345-0@lo:400: 00000100:00100000:1.0:1789135764.330638:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666663808:12345-0@lo:400: Request processed in 44us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.330644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135764.330655:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135764.330661:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666664320:12345-0@lo:400: 00000100:00100000:1.0:1789135764.330688:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666664320:12345-0@lo:400: Request processed in 28us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.330693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135764.330705:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789135764.330711:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666664448:12345-0@lo:400: 00000100:00100000:1.0:1789135764.330737:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666664448:12345-0@lo:400: Request processed in 26us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.330742:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789135764.330766:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135764.330773:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666664064:12345-0@lo:400: 00000100:00100000:1.0:1789135764.330800:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666664064:12345-0@lo:400: Request processed in 27us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.330806:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789135764.330834:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135764.330837:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135764.330876:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f660a940 x1876044666664064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135764.330893:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666664064:0@lo:400: 00000100:00100000:1.0:1789135764.330908:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666663936:0@lo:400: 00010000:00080000:1.0:1789135764.330917:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da4780 x1876044666664448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135764.330926:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666664448:0@lo:400: 00010000:00080000:1.0:1789135764.330956:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6609a40 x1876044666663808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135764.330965:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666663808:0@lo:400: 00010000:00080000:1.0:1789135764.330975:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da5a40 x1876044666664320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135764.330983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666664320:0@lo:400: 00000100:00100000:1.0:1789135764.330994:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666664192:0@lo:400: 00000100:00100000:2.0:1789135764.334896:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666664832:0@lo:13: 00000100:00100000:2.0:1789135764.334974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135764.335040:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664832 00000100:00100000:2.0:1789135764.335049:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664832 00000100:00100000:2.0:1789135764.335102:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135764.335110:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666664832:12345-0@lo:13: 00002000:00000024:2.0:1789135764.335145:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135764.335186:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666664832:12345-0@lo:13: Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135764.335194:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789135764.335233:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6b02940 x1876044666664832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135764.335253:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666664832:0@lo:13: 00000100:00100000:1.0:1789135764.337811:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135764.337834:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666664960:0@lo:13: 00000100:00100000:1.0:1789135764.337909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135764.337955:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666664960 00000100:00100000:1.0:1789135764.337961:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666664960 00000100:00100000:1.0:1789135764.338000:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789135764.338007:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666664960:12345-0@lo:13: 00002000:00000024:1.0:1789135764.338047:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135764.338086:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666664960:12345-0@lo:13: Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135764.338092:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789135764.338134:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55af840 x1876044666664960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135764.338153:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666664960:0@lo:13: 00000100:00100000:0.0:1789135764.338297:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666663680 00000100:00100000:0.0:1789135764.338302:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666663680 00000100:00100000:0.0:1789135764.338336:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789135764.338343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3640:x1876044666663680:12345-0@lo:400: 00000100:00100000:0.0:1789135764.338433:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3640:x1876044666663680:12345-0@lo:400: Request processed in 90us (9352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135764.338440:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789135764.340662:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666663680:0@lo:400: 00010000:00010000:2.0:1789135764.648656:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789135764.843606:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000020:00000004:0.0:1789135765.286209:0:8859:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789135765.286684:0:8859:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789135765.354962:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135765.354989:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2312580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666665088:0@lo:41: 00000100:00100000:0.0:1789135765.355060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135765.355291:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665088 00000100:00100000:0.0:1789135765.355298:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665088 00000100:00100000:0.0:1789135765.355336:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135765.355345:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666665088:12345-0@lo:41: 00000004:00000024:0.0:1789135765.355376:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789135765.355419:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666665088:12345-0@lo:41: Request processed in 75us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135765.355426:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135765.355467:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2312580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666665088:0@lo:41: 00010000:00010000:2.0:1789135765.676633:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135766.696433:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135767.720670:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789135768.211566:0:8961:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789135768.211980:0:8961:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789135768.763049:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135768.936363:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666665216:0@lo:41: 00000100:00100000:3.0:1789135768.936452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135768.936615:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665216 00000100:00100000:2.0:1789135768.936624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665216 00000100:00100000:2.0:1789135768.936699:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135768.936709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666665216:12345-0@lo:41: 00000004:00000024:2.0:1789135768.936744:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789135768.936790:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666665216:12345-0@lo:41: Request processed in 83us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135768.936798:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789135768.937318:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666665216:0@lo:41: 00000020:00000004:0.0:1789135769.090320:0:9009:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789135769.090330:0:9009:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789135769.448291:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135769.449749:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666665472:0@lo:13: 00000100:00100000:0.0:1789135769.449829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135769.450095:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665472 00000100:00100000:3.0:1789135769.450103:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665472 00000100:00100000:3.0:1789135769.450166:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135769.450176:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666665472:12345-0@lo:13: 00002000:00000024:3.0:1789135769.450206:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135769.450272:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666665472:12345-0@lo:13: Request processed in 98us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135769.450280:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789135769.450301:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135769.450331:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da4f00 x1876044666665472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135769.450350:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666665472:0@lo:13: 00000100:00100000:0.0:1789135769.451710:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666665600:0@lo:400: 00000100:00100000:0.0:1789135769.451760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135769.451808:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666666112:0@lo:400: 00000100:00100000:0.0:1789135769.451835:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135769.451882:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135769.451888:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666665984:0@lo:400: 00000100:00100000:0.0:1789135769.451920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135769.451948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666112 00000100:00100000:0.0:1789135769.451952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666112 00000100:00100000:0.0:1789135769.451995:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135769.452004:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666666112:12345-0@lo:400: 00000100:00100000:0.0:1789135769.452057:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2312d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666666112:12345-0@lo:400: Request processed in 54us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135769.452063:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135769.452086:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665984 00000100:00100000:0.0:1789135769.452089:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665984 00000100:00100000:1.0:1789135769.452156:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665600 00000100:00100000:1.0:1789135769.452161:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665600 00000100:00080000:3.0:1789135769.452270:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135769.452305:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666665856:0@lo:400: 00000100:00100000:3.0:1789135769.452335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135769.452357:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666666368:0@lo:400: 00000100:00100000:3.0:1789135769.452380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135769.452536:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135769.452542:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3639:x1876044666665600:12345-0@lo:400: 00000100:00100000:1.0:1789135769.452574:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3639:x1876044666665600:12345-0@lo:400: Request processed in 32us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135769.452580:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135769.452624:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666665600:0@lo:400: 00010000:00080000:1.0:1789135769.452637:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6608f00 x1876044666666112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135769.452650:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666666112:0@lo:400: 00000100:00100000:2.0:1789135769.452879:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666665344:0@lo:13: 00000100:00100000:2.0:1789135769.452914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135769.452940:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666665728:0@lo:400: 00000100:00100000:2.0:1789135769.452961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135769.452975:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666666240:0@lo:400: 00000100:00100000:2.0:1789135769.452992:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135769.453017:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665856 00000100:00100000:2.0:1789135769.453020:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665856 00000100:00100000:2.0:1789135769.453041:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665728 00000100:00100000:2.0:1789135769.453043:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665728 00000100:00100000:2.0:1789135769.453052:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666240 00000100:00100000:2.0:1789135769.453054:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666240 00000100:00100000:2.0:1789135769.453071:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135769.453077:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666665856:12345-0@lo:400: 00000100:00100000:2.0:1789135769.453105:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666665856:12345-0@lo:400: Request processed in 28us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135769.453111:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135769.453134:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135769.453139:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666665728:12345-0@lo:400: 00000100:00100000:2.0:1789135769.453165:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666665728:12345-0@lo:400: Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135769.453183:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135769.453194:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135769.453201:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666666240:12345-0@lo:400: 00000100:00100000:2.0:1789135769.453227:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666666240:12345-0@lo:400: Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135769.453233:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789135769.453251:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135769.453260:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666665344 00000100:00100000:2.0:1789135769.453263:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666665344 00000100:00100000:2.0:1789135769.453291:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789135769.453297:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666665344:12345-0@lo:13: 00002000:00000024:2.0:1789135769.453314:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135769.453360:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666665344:12345-0@lo:13: Request processed in 63us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135769.453366:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789135769.453382:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135769.453399:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f66092c0 x1876044666665728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135769.453409:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666665728:0@lo:400: 00010000:00080000:2.0:1789135769.453419:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f660a940 x1876044666666240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135769.453427:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666666240:0@lo:400: 00010000:00080000:2.0:1789135769.453443:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55af840 x1876044666665344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135769.453451:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789135769.453470:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666665344:0@lo:13: 00000100:00100000:0.0:1789135769.454288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135769.454298:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666665984:12345-0@lo:400: 00000100:00100000:0.0:1789135769.454348:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666665984:12345-0@lo:400: Request processed in 53us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135769.454354:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135769.454386:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666665984:0@lo:400: 00010000:00080000:3.0:1789135769.456914:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f66083c0 x1876044666665856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135769.456934:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666665856:0@lo:400: 00000100:00100000:2.0:1789135769.458334:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666368 00000100:00100000:2.0:1789135769.458345:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666368 00000100:00100000:2.0:1789135769.458476:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789135769.458487:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666666368:12345-0@lo:400: 00000100:00100000:2.0:1789135769.458581:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666666368:12345-0@lo:400: Request processed in 97us (6199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135769.458589:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789135769.458674:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e83c0 x1876044666666368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135769.458688:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666666368:0@lo:400: 00010000:00010000:1.0:1789135769.768081:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135770.472003:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135770.472026:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2310f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666666496:0@lo:41: 00000100:00100000:0.0:1789135770.472086:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135770.472142:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666496 00000100:00100000:0.0:1789135770.472149:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666496 00000100:00100000:0.0:1789135770.472196:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789135770.472206:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666666496:12345-0@lo:41: 00000004:00000024:0.0:1789135770.472238:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789135770.472297:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666666496:12345-0@lo:41: Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135770.472304:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789135770.472358:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2310f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666666496:0@lo:41: 00010000:00010000:3.0:1789135770.792906:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135771.816125:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135772.842916:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135773.864718:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135774.056314:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666666624:0@lo:41: 00000100:00100000:0.0:1789135774.056402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135774.056648:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666624 00000100:00100000:2.0:1789135774.056657:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666624 00000100:00100000:2.0:1789135774.056721:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135774.056732:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666666624:12345-0@lo:41: 00000004:00000024:2.0:1789135774.056767:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789135774.060152:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666666624:12345-0@lo:41: Request processed in 3411us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.060168:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789135774.060314:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666666624:0@lo:41: 00000100:00100000:2.0:1789135774.568136:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135774.568166:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666666752:0@lo:13: 00000100:00100000:2.0:1789135774.568249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135774.568318:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666752 00000100:00100000:2.0:1789135774.568325:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666752 00000100:00100000:2.0:1789135774.568382:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789135774.568394:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666666752:12345-0@lo:13: 00000100:00080000:3.0:1789135774.568413:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789135774.568427:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135774.568488:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666666752:12345-0@lo:13: Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.568497:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789135774.568545:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da70c0 x1876044666666752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135774.568585:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666666752:0@lo:13: 00000100:00100000:3.0:1789135774.568811:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666666880:0@lo:13: 00000100:00100000:3.0:1789135774.569028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.569415:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666667008:0@lo:400: 00000100:00100000:1.0:1789135774.569457:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.569489:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135774.569496:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666667136:0@lo:400: 00000100:00100000:1.0:1789135774.569523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135774.569550:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667008 00000100:00100000:1.0:1789135774.569555:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667008 00000100:00100000:1.0:1789135774.569596:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789135774.569605:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666667008:12345-0@lo:400: 00000100:00100000:1.0:1789135774.569647:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666667008:12345-0@lo:400: Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135774.569661:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789135774.569694:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667136 00000100:00100000:1.0:1789135774.569698:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667136 00000100:00100000:1.0:1789135774.569730:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789135774.569737:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666667136:12345-0@lo:400: 00000100:00100000:1.0:1789135774.569772:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666667136:12345-0@lo:400: Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135774.569778:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789135774.569808:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da70c0 x1876044666667136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135774.569820:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666667136:0@lo:400: 00000100:00100000:1.0:1789135774.569829:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666667008:0@lo:400: 00000100:00100000:1.0:1789135774.569895:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666667264:0@lo:400: 00000100:00100000:1.0:1789135774.569920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135774.570783:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666667648:0@lo:400: 00000100:00100000:2.0:1789135774.570819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135774.570870:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135774.570877:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666667520:0@lo:400: 00000100:00100000:2.0:1789135774.570901:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135774.570929:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667264 00000100:00100000:2.0:1789135774.570934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667264 00000100:00100000:2.0:1789135774.570960:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667648 00000100:00100000:2.0:1789135774.570963:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667648 00000100:00100000:2.0:1789135774.570985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667520 00000100:00100000:2.0:1789135774.570988:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667520 00000100:00100000:2.0:1789135774.571000:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789135774.571007:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666667264:12345-0@lo:400: 00000100:00100000:2.0:1789135774.571043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666667264:12345-0@lo:400: Request processed in 36us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.571050:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789135774.571064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789135774.571069:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666667648:12345-0@lo:400: 00000100:00100000:2.0:1789135774.571101:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666667648:12345-0@lo:400: Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.571107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789135774.571121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789135774.571127:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666667520:12345-0@lo:400: 00000100:00100000:2.0:1789135774.571153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666667520:12345-0@lo:400: Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.571168:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789135774.571202:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da4780 x1876044666667520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135774.571215:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666667520:0@lo:400: 00010000:00080000:2.0:1789135774.571237:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da70c0 x1876044666667648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135774.571246:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666667648:0@lo:400: 00000100:00100000:2.0:1789135774.571467:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666666880 00000100:00100000:2.0:1789135774.571471:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666666880 00000100:00100000:2.0:1789135774.571499:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789135774.571506:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666666880:12345-0@lo:13: 00002000:00000024:2.0:1789135774.571520:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135774.571554:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666666880:12345-0@lo:13: Request processed in 48us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.571573:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789135774.571683:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2da6d00 x1876044666667264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135774.571693:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666667264:0@lo:400: 00000100:00100000:1.0:1789135774.571706:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135774.571712:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666667392:0@lo:400: 00000100:00100000:1.0:1789135774.571748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135774.571794:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e9a40 x1876044666666880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135774.571810:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666666880:0@lo:13: 00000100:00100000:2.0:1789135774.571880:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667392 00000100:00100000:2.0:1789135774.571885:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667392 00000100:00100000:2.0:1789135774.571914:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135774.571920:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666667392:12345-0@lo:400: 00000100:00100000:2.0:1789135774.571956:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666667392:12345-0@lo:400: Request processed in 36us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135774.571962:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789135774.572044:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666667392:0@lo:400: 00000100:00080000:2.0:1789135774.572162:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135774.572167:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135774.572169:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789135774.891700:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135775.595136:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135775.595166:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666667776:0@lo:41: 00000100:00100000:3.0:1789135775.595241:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135775.595300:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667776 00000100:00100000:1.0:1789135775.595309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667776 00000100:00100000:1.0:1789135775.595373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789135775.595383:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666667776:12345-0@lo:41: 00000004:00000024:1.0:1789135775.595421:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789135775.595472:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666667776:12345-0@lo:41: Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135775.595480:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789135775.595829:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666667776:0@lo:41: 00010000:00010000:3.0:1789135775.912851:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135776.942231:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135777.962227:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135778.984111:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135779.178893:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666667904:0@lo:41: 00000100:00100000:3.0:1789135779.178966:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135779.179088:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666667904 00000100:00100000:0.0:1789135779.179096:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666667904 00000100:00100000:0.0:1789135779.179153:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135779.179163:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666667904:12345-0@lo:41: 00000004:00000024:0.0:1789135779.179199:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789135779.179245:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666667904:12345-0@lo:41: Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.179264:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789135779.179393:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666667904:0@lo:41: 00000100:00100000:3.0:1789135779.688385:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135779.688415:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666668032:0@lo:13: 00000100:00100000:3.0:1789135779.688524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.689112:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668032 00000100:00100000:1.0:1789135779.689122:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668032 00000100:00100000:1.0:1789135779.689178:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135779.689188:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666668032:12345-0@lo:13: 00002000:00000024:1.0:1789135779.689219:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135779.689276:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666668032:12345-0@lo:13: Request processed in 90us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.689283:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789135779.689328:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e9a40 x1876044666668032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135779.689348:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666668032:0@lo:13: 00000100:00080000:2.0:1789135779.689725:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135779.690315:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666668288:0@lo:400: 00000100:00100000:1.0:1789135779.690370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.690396:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666668800:0@lo:400: 00000100:00100000:1.0:1789135779.690419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.690441:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789135779.690448:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666668416:0@lo:400: 00000100:00100000:1.0:1789135779.690731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135779.690741:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666668544:0@lo:400: 00000100:00100000:1.0:1789135779.690761:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666668928:0@lo:400: 00000100:00100000:2.0:1789135779.690785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.690797:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135779.690815:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789135779.690823:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666668160:0@lo:400: 00000100:00100000:1.0:1789135779.690834:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668288 00000100:00100000:1.0:1789135779.690841:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668288 00000100:00100000:2.0:1789135779.690882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135779.690979:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668800 00000100:00100000:1.0:1789135779.690983:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668800 00000100:00100000:1.0:1789135779.691085:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668416 00000100:00100000:1.0:1789135779.691089:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668416 00000100:00100000:1.0:1789135779.691106:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135779.691114:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666668288:12345-0@lo:400: 00000100:00100000:1.0:1789135779.691171:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666668288:12345-0@lo:400: Request processed in 58us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.691178:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135779.691194:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135779.691200:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666668800:12345-0@lo:400: 00000100:00100000:1.0:1789135779.691223:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666668800:12345-0@lo:400: Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.691229:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135779.691238:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135779.691254:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6889680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666668416:12345-0@lo:400: 00000100:00100000:1.0:1789135779.691278:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6889680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666668416:12345-0@lo:400: Request processed in 35us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135779.691284:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789135779.691823:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668928 00000100:00100000:0.0:1789135779.691830:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668928 00000100:00100000:0.0:1789135779.691898:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789135779.691906:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666668928:12345-0@lo:400: 00000100:00100000:0.0:1789135779.691951:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666668928:12345-0@lo:400: Request processed in 46us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135779.691957:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789135779.692063:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f68883c0 x1876044666668416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135779.692089:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666668416:0@lo:400: 00010000:00080000:3.0:1789135779.692107:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f68892c0 x1876044666668928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135779.692134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666668928:0@lo:400: 00010000:00080000:3.0:1789135779.692147:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e83c0 x1876044666668288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135779.692155:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666668288:0@lo:400: 00010000:00080000:3.0:1789135779.692171:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f688a580 x1876044666668800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135779.692178:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666668800:0@lo:400: 00000100:00100000:2.0:1789135779.697919:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666668672:0@lo:400: 00000100:00100000:2.0:1789135779.700871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135779.700945:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668672 00000100:00100000:2.0:1789135779.700953:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668672 00000100:00100000:2.0:1789135779.701009:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789135779.701019:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666668672:12345-0@lo:400: 00000100:00100000:2.0:1789135779.701070:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666668672:12345-0@lo:400: Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.701077:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789135779.701102:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668160 00000100:00100000:2.0:1789135779.701106:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668160 00000100:00100000:2.0:1789135779.701130:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789135779.701136:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666668160:12345-0@lo:400: 00000100:00100000:2.0:1789135779.701164:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666668160:12345-0@lo:400: Request processed in 28us (10283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.701170:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1789135779.701195:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135779.701199:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135779.701202:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789135779.701235:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f688b840 x1876044666668672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135779.701395:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666668672:0@lo:400: 00000100:00100000:2.0:1789135779.701424:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2311a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666669056:0@lo:13: 00000100:00100000:2.0:1789135779.701453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135779.701486:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669056 00000100:00100000:2.0:1789135779.701491:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669056 00000100:00100000:2.0:1789135779.702719:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789135779.702738:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666669056:12345-0@lo:13: 00002000:00000024:2.0:1789135779.702761:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135779.702816:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666669056:12345-0@lo:13: Request processed in 86us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135779.702825:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789135779.702896:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c2311a40 x1876044666669056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135779.702916:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2311a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666669056:0@lo:13: 00000100:00100000:2.0:1789135779.702928:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666668160:0@lo:400: 00000100:00100000:3.0:1789135779.705247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666668544 00000100:00100000:3.0:1789135779.705261:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666668544 00000100:00100000:3.0:1789135779.705327:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789135779.705337:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666668544:12345-0@lo:400: 00000100:00100000:3.0:1789135779.705439:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666668544:12345-0@lo:400: Request processed in 103us (14655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135779.705447:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789135779.706575:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666668544:0@lo:400: 00010000:00010000:1.0:1789135780.009539:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789135780.043956:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789135780.043960:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789135780.043962:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789135780.044088:0:9509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a6c2291000 00000020:01000004:3.0:1789135780.044105:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789135780.044119:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789135780.044133:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a7f64b4ed8) 00000020:00000080:3.0:1789135780.044149:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789135780.115325:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789135780.115583:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789135780.148897:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789135780.149100:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789135780.149115:0:9509:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789135780.149127:0:9509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x559c8745c6de2848 00000020:01000004:3.0:1789135780.149141:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789135780.149166:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789135780.149170:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789135780.149176:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789135780.149204:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789135780.149208:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789135780.185305:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789135780.185368:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789135780.185372:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789135780.185374:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135780.185375:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135780.185376:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135780.185377:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135780.185378:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135780.185380:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135780.185381:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135780.185387:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135780.185389:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135780.185390:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135780.185403:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789135780.185406:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789135780.185407:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135780.185408:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135780.185409:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789135780.185410:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135780.185411:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135780.185412:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135780.185413:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789135780.185414:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789135780.185415:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135780.185416:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789135780.185441:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789135780.185469:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23130c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666669184:0@lo:253: 00000100:00100000:0.0:1789135780.185554:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.185616:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ef985600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.186126:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669184 00000100:00100000:1.0:1789135780.186135:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669184 00000100:00100000:1.0:1789135780.186187:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789135780.186196:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:9509:x1876044666669184:12345-0@lo:253: 20000000:01000000:1.0:1789135780.186237:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789135780.186241:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789135780.186247:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789135780.186250:0:6508:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789135780.186517:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789135780.186651:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789135780.186665:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789135780.186683:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789135780.186689:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789135780.186702:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789135780.186717:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789135780.186803:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789135780.186818:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1789135780.186820:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135780.186836:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789135780.186841:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135780.187330:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789135780.187341:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135780.187379:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789135780.187388:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135780.187414:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789135780.187432:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789135780.187525:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789135780.187539:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1789135780.187541:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135780.187555:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789135780.187561:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789135780.187575:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789135780.187581:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135780.187594:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789135780.187609:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135780.187624:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789135780.187640:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789135780.188621:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789135780.188641:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1789135780.188643:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1789135780.188658:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789135780.188664:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789135780.188676:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789135780.188680:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1789135780.188692:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789135780.188697:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789135780.188709:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789135780.188722:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789135780.188733:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789135780.188736:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789135780.188739:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789135780.188784:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789135780.188786:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135780.190620:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135780.190670:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135780.190686:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789135780.191281:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789135780.191329:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789135780.191348:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789135780.191359:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789135780.191361:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135780.191872:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135780.191900:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135780.191909:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789135780.192209:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789135780.192228:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789135780.192240:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789135780.192249:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789135780.192250:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789135780.192731:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789135780.192761:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789135780.192774:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789135780.192911:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789135780.192944:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789135780.192958:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789135780.192966:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789135780.192973:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789135780.193714:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789135780.194184:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789135780.194207:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789135780.194222:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789135780.194230:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789135780.194232:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789135780.194833:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789135780.195094:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789135780.195120:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789135780.195379:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789135780.195482:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789135780.195497:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:2.0:1789135780.195514:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789135780.195535:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196156:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de273e expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196167:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2768 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196175:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196182:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196189:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27ed expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196196:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2809 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196203:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2833 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196210:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196263:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2833 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196278:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2833 expref: 21 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.196361:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669312:0@lo:104: 00000100:00100000:2.0:1789135780.196516:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135780.196618:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2809 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196627:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2809 expref: 21 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.196636:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669440:0@lo:104: 00000100:00100000:2.0:1789135780.196657:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135780.196740:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de27ed expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.196750:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de27ed expref: 21 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.196758:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669568:0@lo:104: 00000100:00100000:2.0:1789135780.196778:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.196869:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669312 00000100:00100000:1.0:1789135780.196875:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669312 00000100:00100000:1.0:1789135780.196912:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669440 00000100:00100000:1.0:1789135780.196915:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669440 00000100:00100000:1.0:1789135780.196942:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135780.196951:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6508:x1876044666669312:12345-0@lo:104: 00010000:00010000:1.0:1789135780.196964:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197028:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135780.197033:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6508:x1876044666669312:12345-0@lo:104: Request processed in 84us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.197040:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135780.197060:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135780.197066:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6508:x1876044666669440:12345-0@lo:104: 00010000:00010000:1.0:1789135780.197074:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197104:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135780.197109:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6508:x1876044666669440:12345-0@lo:104: Request processed in 44us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.197125:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789135780.197143:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135780.197148:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197156:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135780.197160:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197168:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135780.197175:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135780.197181:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135780.197208:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197215:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135780.197238:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197245:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dc200/0x559c8745c6de2833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de283a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197257:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135780.197260:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197276:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135780.197279:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197286:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135780.197301:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135780.197306:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135780.197320:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197326:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135780.197342:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197349:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878400/0x559c8745c6de2809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2810 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197358:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.197360:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.197361:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135780.197384:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666669696:0@lo:103: 00000100:00100000:1.0:1789135780.197421:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.197452:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666669824:0@lo:103: 00000100:00100000:1.0:1789135780.197482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.197520:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669696 00000100:00100000:1.0:1789135780.197524:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669696 00010000:00010000:1.0:1789135780.197542:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2833 expref: 22 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.197561:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669824 00000100:00100000:1.0:1789135780.197564:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669824 00010000:00010000:1.0:1789135780.197573:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2809 expref: 23 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.197590:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135780.197596:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3639:x1876044666669696:12345-0@lo:103: 00010000:00010000:1.0:1789135780.197605:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.197610:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2833 expref: 23 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197619:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2833 expref: 23 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197635:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135780.197661:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3639:x1876044666669696:12345-0@lo:103: Request processed in 65us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.197668:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135780.197680:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135780.197685:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3640:x1876044666669824:12345-0@lo:103: 00010000:00010000:1.0:1789135780.197692:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.197696:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2809 expref: 22 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197704:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2809 expref: 22 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.197720:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135780.197747:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3640:x1876044666669824:12345-0@lo:103: Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.197754:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789135780.197798:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666669824:0@lo:103: 00000100:00100000:1.0:1789135780.197822:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666669696:0@lo:103: 00010000:00010000:0.0:1789135780.198196:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135780.198546:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.198558:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 21 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.198583:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669952:0@lo:104: 00000100:00100000:2.0:1789135780.198629:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135780.198650:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.198659:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 21 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.198667:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe03c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666670080:0@lo:104: 00000100:00100000:2.0:1789135780.198695:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135780.198711:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2768 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.198719:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2768 expref: 21 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.198727:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666670208:0@lo:104: 00000100:00100000:2.0:1789135780.198749:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135780.198765:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de273e expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.198773:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de273e expref: 21 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.198781:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666670336:0@lo:104: 00000100:00100000:2.0:1789135780.198797:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3180 going to sleep for 11 seconds 00010000:00010000:2.0:1789135780.198812:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dc400/0x559c8745c6de283a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2833 expref: 21 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.198835:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669312:0@lo:104: 00010000:00010000:2.0:1789135780.198847:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2809 expref: 20 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.198877:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669440:0@lo:104: 00000100:00100000:1.0:1789135780.199095:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789135780.199113:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.199125:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669568 00000100:00100000:1.0:1789135780.199129:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669568 00000100:00100000:1.0:1789135780.199154:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666669952 00000100:00100000:1.0:1789135780.199157:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666669952 00000100:00100000:1.0:1789135780.199166:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670080 00000100:00100000:1.0:1789135780.199168:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670080 00000100:00100000:1.0:1789135780.199176:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670208 00000100:00100000:1.0:1789135780.199178:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670208 00000100:00100000:1.0:1789135780.199185:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670336 00000100:00100000:1.0:1789135780.199187:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670336 00000100:00100000:1.0:1789135780.199198:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135780.199204:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:6508:x1876044666669568:12345-0@lo:104: 00010000:00010000:1.0:1789135780.199215:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.199267:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135780.199273:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:6508:x1876044666669568:12345-0@lo:104: Request processed in 69us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.199279:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789135780.199366:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135780.199372:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.199380:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879c00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135780.199383:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.199391:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135780.199408:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135780.199413:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135780.199448:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.199454:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135780.199476:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.199484:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879c00/0x559c8745c6de27ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.199495:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.199496:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.199498:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135780.199589:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135780.199602:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:6508:x1876044666669952:12345-0@lo:104: 00010000:00010000:1.0:1789135780.199611:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.199653:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135780.199659:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:6508:x1876044666669952:12345-0@lo:104: Request processed in 58us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.199665:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135780.199679:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789135780.199685:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6508:x1876044666670080:12345-0@lo:104: 00010000:00010000:1.0:1789135780.199692:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.199724:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135780.199729:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:6508:x1876044666670080:12345-0@lo:104: Request processed in 45us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.199735:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789135780.199748:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135780.199753:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f7def450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6508:x1876044666670208:12345-0@lo:104: 00010000:00010000:1.0:1789135780.199760:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.199783:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789135780.199787:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f7def450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:6508:x1876044666670208:12345-0@lo:104: Request processed in 36us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.199792:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789135780.199820:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789135780.199832:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6889e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6508:x1876044666670336:12345-0@lo:104: 00010000:00010000:1.0:1789135780.199839:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.199888:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789135780.199892:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6889e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6508:x1876044666670336:12345-0@lo:104: Request processed in 63us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.199898:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789135780.199917:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2311a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666670464:0@lo:103: 00000100:00100000:1.0:1789135780.199955:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135780.200078:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789135780.200084:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200091:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135780.200094:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200100:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135780.200106:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135780.200111:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135780.200128:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200133:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135780.200153:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200160:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de27c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27ca expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200170:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789135780.200173:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200178:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135780.200181:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200188:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135780.200193:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135780.200199:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135780.200211:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200216:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135780.200221:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200227:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de27a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27ae expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200235:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135780.200243:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200249:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135780.200252:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200259:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135780.200265:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135780.200270:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135780.200283:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200288:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135780.200472:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200480:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e800/0x559c8745c6de2768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de276f expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200490:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135780.200493:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200499:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dd400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135780.200502:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200520:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135780.200526:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135780.200531:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135780.200546:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200552:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135780.200557:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200563:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dd400/0x559c8745c6de273e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2745 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.200576:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.200578:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.200579:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135780.200624:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666670976:0@lo:103: 00000100:00100000:1.0:1789135780.200655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.200685:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135780.200691:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2312940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666670848:0@lo:103: 00000100:00100000:1.0:1789135780.200712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.200738:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670464 00000100:00100000:1.0:1789135780.200744:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670464 00010000:00010000:1.0:1789135780.200762:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27ed expref: 20 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.200785:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670976 00000100:00100000:1.0:1789135780.200788:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670976 00010000:00010000:1.0:1789135780.200798:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de273e expref: 21 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.200806:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670848 00000100:00100000:1.0:1789135780.200808:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670848 00010000:00010000:1.0:1789135780.200815:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2768 expref: 22 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.200841:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135780.200847:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3641:x1876044666670464:12345-0@lo:103: 00010000:00010000:1.0:1789135780.200945:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.200951:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27ed expref: 22 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.200962:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de27ed expref: 22 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.200978:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135780.201076:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666670592:0@lo:103: 00000100:00100000:2.0:1789135780.201104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135780.201123:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135780.201128:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666670720:0@lo:103: 00000100:00100000:2.0:1789135780.201145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135780.201178:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de27f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de27ed expref: 22 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.201189:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669568:0@lo:104: 00000100:00100000:2.0:1789135780.201199:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666669952:0@lo:104: 00000100:00100000:2.0:1789135780.201206:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe03c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666670080:0@lo:104: 00000100:00100000:2.0:1789135780.201213:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666670208:0@lo:104: 00000100:00100000:2.0:1789135780.201220:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1876044666670336:0@lo:104: 00010000:00010000:2.0:1789135780.201252:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.201472:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670592 00000100:00100000:0.0:1789135780.201476:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670592 00010000:00010000:0.0:1789135780.201494:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 22 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.201508:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666670720 00000100:00100000:0.0:1789135780.201511:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666670720 00010000:00010000:0.0:1789135780.201521:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 23 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.201532:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135780.201546:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3641:x1876044666670976:12345-0@lo:103: 00010000:00010000:0.0:1789135780.201555:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135780.201559:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de273e expref: 23 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201567:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de273e expref: 23 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201577:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dde00/0x559c8745c6de2745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de273e expref: 23 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201586:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135780.201621:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3641:x1876044666670976:12345-0@lo:103: Request processed in 75us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.201627:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135780.201643:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135780.201648:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6889a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3641:x1876044666670848:12345-0@lo:103: 00010000:00010000:0.0:1789135780.201656:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135780.201660:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2768 expref: 21 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201667:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2768 expref: 21 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201677:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879600/0x559c8745c6de276f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2768 expref: 21 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201684:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135780.201706:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6889a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666670848:12345-0@lo:103: Request processed in 58us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.201721:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135780.201734:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135780.201740:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+19:3638:x1876044666670592:12345-0@lo:103: 00010000:00010000:0.0:1789135780.201748:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135780.201752:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 19 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201760:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 19 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201769:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878600/0x559c8745c6de27ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de27c3 expref: 19 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201778:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135780.201800:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3638:x1876044666670592:12345-0@lo:103: Request processed in 61us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.201806:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789135780.201818:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789135780.201823:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3638:x1876044666670720:12345-0@lo:103: 00010000:00010000:0.0:1789135780.201842:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135780.201847:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 17 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201881:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 17 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201890:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878200/0x559c8745c6de27ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de27a7 expref: 17 pid: 6510 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201911:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201920:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201933:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201941:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201947:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201954:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201960:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ec00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135780.201964:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.201971:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.202126:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666670592:0@lo:103: 00000100:00100000:1.0:1789135780.202537:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3641:x1876044666670464:12345-0@lo:103: Request processed in 1689us (2579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.202546:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789135780.202627:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2312940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666670848:0@lo:103: 00000100:00100000:1.0:1789135780.202636:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666670976:0@lo:103: 00000100:00100000:1.0:1789135780.202643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2311a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666670464:0@lo:103: 00010000:00010000:1.0:1789135780.202673:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.202721:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.202733:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135780.202821:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3638:x1876044666670720:12345-0@lo:103: Request processed in 998us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.202839:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789135780.202935:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.202954:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.202961:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de284f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135780.202975:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789135780.204249:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23103c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666670720:0@lo:103: 00000100:00100000:2.0:1789135780.205512:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+14:9509:x1876044666669184:12345-0@lo:253: Request processed in 19311us (19952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.205525:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789135780.205662:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23130c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666669184:0@lo:253: 10000000:01000000:0.0:1789135780.205677:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789135780.205681:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789135780.205682:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789135780.205683:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789135780.205685:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789135780.205686:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789135780.205687:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789135780.205689:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789135780.205690:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789135780.205692:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789135780.205693:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789135780.205713:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a6c2291000 from lustre-OST0001 10000000:01000000:0.0:1789135780.205743:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789135780.205746:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789135780.205755:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a7efa18000 local copy 10000000:01000000:0.0:1789135780.205758:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789135780.205793:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.205803:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.205811:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135780.205828:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671104:0@lo:101: 00000100:00100000:0.0:1789135780.206131:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.206253:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ef985480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.206288:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671104 00000100:00100000:2.0:1789135780.206367:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671104 00000100:00100000:2.0:1789135780.206624:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789135780.206634:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+14:9509:x1876044666671104:12345-0@lo:101: 00010000:00010000:2.0:1789135780.206647:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135780.206662:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de285d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2856 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206686:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de285d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2856 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206696:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de285d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2856 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.206705:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ea00, rc 0) 00000100:00100000:2.0:1789135780.206756:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671104:12345-0@lo:101: Request processed in 123us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.206762:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789135780.206895:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671104:0@lo:101: 00010000:00010000:3.0:1789135780.206910:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.206921:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.207060:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671232:0@lo:501: 00000100:00100000:3.0:1789135780.207091:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.207627:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.207724:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671232 00000100:00100000:0.0:1789135780.207740:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671232 00000100:00100000:0.0:1789135780.207769:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789135780.207776:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671232:12345-0@lo:501: 00000100:00100000:0.0:1789135780.207873:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671232:12345-0@lo:501: Request processed in 97us (782us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135780.207880:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789135780.207958:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671232:0@lo:501: 10000000:01000000:3.0:1789135780.207973:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789135780.208112:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789135780.208118:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.208127:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.208134:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.208167:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789135780.208197:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a6c2291000 10000000:01000000:3.0:1789135780.208202:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789135780.208207:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789135780.208209:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135780.208214:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789135780.208217:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789135780.208239:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.208246:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.208254:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.208270:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671360:0@lo:101: 00010000:00010000:0.0:1789135780.208380:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135780.208387:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208403:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031e00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135780.208407:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208416:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135780.208423:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135780.208429:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135780.208447:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208453:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135780.208481:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208488:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x559c8745c6de285d expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208511:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.208513:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135780.208514:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135780.208525:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666671488:0@lo:103: 00000100:00100000:0.0:1789135780.208554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.208602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671488 00000100:00100000:0.0:1789135780.208607:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671488 00000100:00100000:0.0:1789135780.208638:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135780.208645:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3638:x1876044666671488:12345-0@lo:103: 00010000:00010000:0.0:1789135780.208655:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135780.208669:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de285d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2856 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.208683:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135780.208710:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:3638:x1876044666671488:12345-0@lo:103: Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.208717:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135780.208745:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666671488:0@lo:103: 00000100:00100000:3.0:1789135780.208891:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.208910:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.209192:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671360 00000100:00100000:0.0:1789135780.209196:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671360 00000100:00100000:0.0:1789135780.209217:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789135780.209224:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+14:9509:x1876044666671360:12345-0@lo:101: 00010000:00010000:0.0:1789135780.209233:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135780.209244:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2864 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.209277:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2864 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.209288:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2864 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135780.209307:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:0.0:1789135780.209336:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671360:12345-0@lo:101: Request processed in 113us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.209342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789135780.209531:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671360:0@lo:101: 00010000:00010000:3.0:1789135780.209544:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.209552:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.209644:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671616:0@lo:501: 00000100:00100000:3.0:1789135780.209678:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.209709:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.209775:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671616 00000100:00100000:2.0:1789135780.209779:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671616 00000100:00100000:2.0:1789135780.209809:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789135780.209816:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671616:12345-0@lo:501: 00000100:00100000:2.0:1789135780.209967:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671616:12345-0@lo:501: Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.209976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789135780.210148:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671616:0@lo:501: 00000100:00100000:3.0:1789135780.210176:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671744:0@lo:503: 00000100:00100000:3.0:1789135780.210219:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.210237:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.210299:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671744 00000100:00100000:2.0:1789135780.210303:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671744 00000100:00100000:2.0:1789135780.210321:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789135780.210327:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671744:12345-0@lo:503: 00000100:00100000:2.0:1789135780.210536:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671744:12345-0@lo:503: Request processed in 208us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.210543:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789135780.210643:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671744:0@lo:503: 00000040:00080000:3.0:1789135780.210898:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135780.211000:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671872:0@lo:502: 00000100:00100000:3.0:1789135780.211036:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.211053:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.211197:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666671872 00000100:00100000:0.0:1789135780.211202:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666671872 00000100:00100000:0.0:1789135780.211225:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789135780.211232:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671872:12345-0@lo:502: 00000100:00100000:0.0:1789135780.212273:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666671872:12345-0@lo:502: Request processed in 1037us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.212282:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789135780.212595:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666671872:0@lo:502: 00000040:00080000:3.0:1789135780.212833:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789135780.212897:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789135780.212913:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789135780.212938:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789135780.212952:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789135780.212965:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789135780.213005:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672000:0@lo:502: 00000100:00100000:3.0:1789135780.213052:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.213092:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.213380:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672000 00000100:00100000:1.0:1789135780.213387:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672000 00000100:00100000:1.0:1789135780.213514:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789135780.213523:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666672000:12345-0@lo:502: 00000100:00100000:1.0:1789135780.213621:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666672000:12345-0@lo:502: Request processed in 99us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.213628:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789135780.213679:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672000:0@lo:502: 00000040:00080000:1.0:1789135780.213732:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789135780.213740:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789135780.214743:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789135780.214753:0:9520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789135780.214759:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135780.214762:0:9520:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789135780.214772:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789135780.214788:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a7efa19a48) 00000020:00000080:0.0:1789135780.214815:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789135780.214820:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789135780.215261:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c2291000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789135780.215273:0:9520:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789135780.215280:0:9520:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x559c8745c6de2879 00010000:00010000:0.0:1789135780.222390:0:9520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1789135780.222784:0:9520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789135780.227773:0:9520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789135780.229543:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789135780.238682:0:9520:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789135780.238971:0:9520:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789135780.246529:0:9520:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789135780.252914:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789135780.253051:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135780.253060:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135780.253063:0:9520:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789135780.253067:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135780.253072:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135780.253073:0:9520:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789135780.253076:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789135780.253077:0:9520:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789135780.253095:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135780.253097:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135780.253098:0:9520:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789135780.253101:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789135780.253300:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789135780.253327:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789135780.253348:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.253360:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135780.253367:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c2291000 from 1 10000000:01000000:2.0:1789135780.253369:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135780.253779:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.253789:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.253812:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.253836:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672128:0@lo:101: 00000100:00100000:2.0:1789135780.253941:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135780.254076:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.254103:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672128 00000100:00100000:2.0:1789135780.254110:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672128 00000100:00100000:2.0:1789135780.254157:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789135780.254166:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666672128:12345-0@lo:101: 00010000:00010000:2.0:1789135780.254179:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135780.254191:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2880 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.254214:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2880 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.254225:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2880 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.254233:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e600, rc 0) 00000100:00100000:2.0:1789135780.254491:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672128:12345-0@lo:101: Request processed in 325us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.254498:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789135780.254553:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672128:0@lo:101: 00010000:00010000:2.0:1789135780.254567:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.254589:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.254679:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672256:0@lo:501: 00000100:00100000:2.0:1789135780.255520:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135780.255561:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.255648:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672256 00000100:00100000:0.0:1789135780.255653:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672256 00000100:00100000:0.0:1789135780.255768:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789135780.255779:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672256:12345-0@lo:501: 00000100:00100000:0.0:1789135780.255907:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672256:12345-0@lo:501: Request processed in 130us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.255914:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135780.256559:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672256:0@lo:501: 00000100:00100000:2.0:1789135780.256607:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672384:0@lo:503: 00000100:00100000:2.0:1789135780.256656:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135780.256686:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.257226:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672384 00000100:00100000:2.0:1789135780.257232:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672384 00000100:00100000:2.0:1789135780.257513:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789135780.257523:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672384:12345-0@lo:503: 00000100:00100000:2.0:1789135780.257633:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672384:12345-0@lo:503: Request processed in 111us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.257640:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789135780.257722:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672384:0@lo:503: 00000040:00080000:3.0:1789135780.257977:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789135780.258064:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672512:0@lo:502: 00000100:00100000:3.0:1789135780.258097:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.265485:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.265649:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672512 00000100:00100000:0.0:1789135780.265660:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672512 00000100:00100000:0.0:1789135780.265720:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789135780.265731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672512:12345-0@lo:502: 00000100:00100000:0.0:1789135780.265924:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672512:12345-0@lo:502: Request processed in 194us (7826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.265932:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789135780.266135:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672512:0@lo:502: 00000040:00080000:3.0:1789135780.266469:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789135780.266505:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789135780.266538:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672640:0@lo:502: 00000100:00100000:3.0:1789135780.266584:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.266621:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135780.266679:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672640 00000100:00100000:0.0:1789135780.266683:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672640 00000100:00100000:0.0:1789135780.266724:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789135780.266731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672640:12345-0@lo:502: 00000100:00100000:0.0:1789135780.266814:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672640:12345-0@lo:502: Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.266821:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789135780.266975:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672640:0@lo:502: 00000040:00080000:3.0:1789135780.267014:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789135780.267021:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789135780.267576:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135780.267586:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135780.267588:0:9524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789135780.267596:0:9524:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c2291000 00000020:00000080:1.0:1789135780.267599:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789135780.267611:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135780.267613:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135780.267614:0:9524:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789135780.267617:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789135780.267746:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789135780.267771:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135780.267793:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.267804:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135780.267880:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789135780.267883:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a6c2291000 10000000:01000000:3.0:1789135780.267886:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a6c2291000 10000000:01000000:3.0:1789135780.267890:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789135780.267895:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6c2291000 from 1 10000000:01000000:3.0:1789135780.267898:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789135780.267925:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.267933:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.267943:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.267966:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672768:0@lo:101: 00000100:00100000:3.0:1789135780.268005:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.268041:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.268117:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672768 00000100:00100000:1.0:1789135780.268123:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672768 00000100:00100000:1.0:1789135780.268153:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135780.268160:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9509:x1876044666672768:12345-0@lo:101: 00010000:00010000:1.0:1789135780.268170:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135780.268182:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de288e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.268203:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de288e expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.268213:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de288e expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.268234:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878400, rc 0) 00000100:00100000:1.0:1789135780.268269:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666672768:12345-0@lo:101: Request processed in 109us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.268276:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135780.268318:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672768:0@lo:101: 00010000:00010000:1.0:1789135780.268331:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.268340:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.268413:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672896:0@lo:501: 00000100:00100000:1.0:1789135780.268438:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.268468:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.268480:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666672896 00000100:00100000:1.0:1789135780.268483:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666672896 00000100:00100000:1.0:1789135780.268498:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789135780.268504:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666672896:12345-0@lo:501: 00000100:00100000:1.0:1789135780.268588:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666672896:12345-0@lo:501: Request processed in 83us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.268594:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789135780.268623:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666672896:0@lo:501: 00000100:00100000:1.0:1789135780.268647:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666673024:0@lo:503: 00000100:00100000:1.0:1789135780.268683:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.268695:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.268712:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673024 00000100:00100000:1.0:1789135780.268716:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673024 00000100:00100000:1.0:1789135780.268732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135780.268738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666673024:12345-0@lo:503: 00000100:00100000:1.0:1789135780.268804:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666673024:12345-0@lo:503: Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.268811:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135780.268870:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666673024:0@lo:503: 00000040:00080000:1.0:1789135780.269081:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789135780.269139:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666673152:0@lo:502: 00000100:00100000:1.0:1789135780.269172:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.269193:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.269206:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673152 00000100:00100000:1.0:1789135780.269209:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673152 00000100:00100000:1.0:1789135780.269225:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135780.269230:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666673152:12345-0@lo:502: 00000100:00100000:1.0:1789135780.269306:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666673152:12345-0@lo:502: Request processed in 75us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.269313:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135780.269348:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666673152:0@lo:502: 00000040:00080000:1.0:1789135780.269523:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789135780.269548:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789135780.269563:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789135780.269576:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789135780.269589:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789135780.269601:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789135780.269612:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789135780.269625:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789135780.269647:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789135780.269662:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789135780.269674:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789135780.269686:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789135780.269698:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789135780.269712:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789135780.269724:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789135780.269735:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789135780.269747:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789135780.269760:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789135780.269786:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789135780.269801:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789135780.269812:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789135780.269823:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789135780.269833:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789135780.269845:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789135780.269883:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789135780.269900:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789135780.269912:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789135780.269924:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789135780.269937:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789135780.269948:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789135780.269960:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789135780.269972:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789135780.269985:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789135780.269999:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789135780.270024:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789135780.270038:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789135780.270050:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789135780.270062:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789135780.270073:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789135780.270086:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789135780.270098:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789135780.270118:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789135780.270130:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789135780.270143:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789135780.270155:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789135780.270166:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789135780.270190:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666673280:0@lo:502: 00000100:00100000:1.0:1789135780.270231:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.270260:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135780.270281:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673280 00000100:00100000:1.0:1789135780.270285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673280 00000100:00100000:1.0:1789135780.270307:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135780.270313:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666673280:12345-0@lo:502: 00000100:00100000:1.0:1789135780.270389:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666673280:12345-0@lo:502: Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.270396:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135780.270437:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666673280:0@lo:502: 00000040:00080000:1.0:1789135780.270487:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789135780.270494:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789135780.271376:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789135780.271476:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a6c3a44ed8) 00000020:00000080:1.0:1789135780.271502:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789135780.271590:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c2291000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789135780.271595:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c2291000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789135780.271597:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c2291000 3 00010000:00080000:1.0:1789135780.271627:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7ff502800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1789135780.273978:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1789135780.274275:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789135780.274325:0:9525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789135780.274339:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x559c8745c6de28a3 00000100:00080000:1.0:1789135780.274357:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135780.274363:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a7ff502800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789135780.274408:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f6888f00 x1876044666673408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135780.274434:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789135780.274732:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666673408:0@lo:38: 00000100:00100000:0.0:1789135780.274806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.274899:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666673920:0@lo:400: 00000100:00100000:0.0:1789135780.274925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.274944:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666674432:0@lo:400: 00000100:00100000:0.0:1789135780.274967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.274987:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135780.274992:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666673536:0@lo:400: 00000100:00100000:0.0:1789135780.275011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.275027:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666674048:0@lo:400: 00000100:00100000:0.0:1789135780.275047:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.275075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673920 00000100:00100000:0.0:1789135780.275081:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673920 00000100:00100000:0.0:1789135780.275127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135780.275136:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666673920:12345-0@lo:400: 00000100:00100000:0.0:1789135780.275198:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666673920:12345-0@lo:400: Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.275205:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135780.275224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673408 00000100:00100000:0.0:1789135780.275227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673408 00000100:00100000:0.0:1789135780.275242:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673536 00000100:00100000:0.0:1789135780.275244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673536 00000100:00100000:0.0:1789135780.275269:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674048 00000100:00100000:0.0:1789135780.275272:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674048 00000100:00100000:0.0:1789135780.275286:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135780.275291:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666673536:12345-0@lo:400: 00000100:00100000:0.0:1789135780.275321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666673536:12345-0@lo:400: Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.275327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135780.275338:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789135780.275344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666674048:12345-0@lo:400: 00000100:00100000:0.0:1789135780.275369:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666674048:12345-0@lo:400: Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.275375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789135780.275386:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789135780.275389:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666673408:12345-0@lo:38: 00010000:00080000:0.0:1789135780.275420:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1789135780.275448:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x559c8745c6de28aa 00000004:00100000:0.0:1789135780.275473:0:6515:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135780.275503:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135780.275542:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876044666673408:12345-0@lo:38: Request processed in 150us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.275549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789135780.275587:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6888f00 x1876044666673408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135780.275598:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135780.275605:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789135780.275612:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789135780.275616:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789135780.275625:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135780.275632:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666673408:0@lo:38: 00010000:00080000:0.0:1789135780.275660:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6b02580 x1876044666673536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135780.275669:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666673536:0@lo:400: 00010000:00080000:0.0:1789135780.275678:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6b00b40 x1876044666674048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135780.275685:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666674048:0@lo:400: 00000100:00100000:0.0:1789135780.275693:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666673920:0@lo:400: 00000100:00100000:1.0:1789135780.276078:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666673664:0@lo:400: 00000100:00100000:1.0:1789135780.276112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.276128:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666674176:0@lo:400: 00000100:00100000:1.0:1789135780.276145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.276163:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789135780.276168:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666673792:0@lo:400: 00000100:00100000:1.0:1789135780.276185:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.276198:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666674304:0@lo:400: 00000100:00100000:1.0:1789135780.276216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.276242:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674176 00000100:00100000:1.0:1789135780.276246:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674176 00000100:00100000:1.0:1789135780.276271:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673792 00000100:00100000:1.0:1789135780.276274:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673792 00000100:00100000:1.0:1789135780.276288:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789135780.276294:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666674176:12345-0@lo:400: 00000100:00100000:1.0:1789135780.276329:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666674176:12345-0@lo:400: Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.276334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789135780.276347:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789135780.276352:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666673792:12345-0@lo:400: 00000100:00100000:1.0:1789135780.276377:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666673792:12345-0@lo:400: Request processed in 25us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.276485:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666673664 00000100:00100000:3.0:1789135780.276489:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666673664 00000100:00100000:3.0:1789135780.276517:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789135780.276523:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666673664:12345-0@lo:400: 00000100:00100000:3.0:1789135780.276561:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666673664:12345-0@lo:400: Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.276567:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135780.276648:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789135780.276687:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f6b03c00 x1876044666673792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135780.276698:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666673792:0@lo:400: 00000100:00100000:1.0:1789135780.276708:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666673664:0@lo:400: 00010000:00080000:1.0:1789135780.276716:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e9a40 x1876044666674176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135780.276723:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666674176:0@lo:400: 00000020:01000004:1.0:1789135780.276840:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1789135780.276935:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674432 00000100:00100000:3.0:1789135780.276939:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674432 00000100:00100000:3.0:1789135780.276963:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674304 00000100:00100000:3.0:1789135780.276965:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674304 00000100:00100000:3.0:1789135780.276988:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135780.276995:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666674432:12345-0@lo:400: 00000100:00100000:3.0:1789135780.277034:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666674432:12345-0@lo:400: Request processed in 39us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.277040:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789135780.277051:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789135780.277057:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666674304:12345-0@lo:400: 00000100:00100000:3.0:1789135780.277106:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666674304:12345-0@lo:400: Request processed in 49us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.277112:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789135780.277182:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e83c0 x1876044666674304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135780.277191:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666674304:0@lo:400: 00000020:00000080:1.0:1789135780.277210:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90a6c3a41a48) 00000020:00000080:1.0:1789135780.277230:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789135780.277315:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c2291000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789135780.277319:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c2291000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789135780.277321:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c2291000 3 00010000:00080000:1.0:1789135780.277349:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c3ba6800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00080000:0.0:1789135780.277533:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3b8d680 x1876044666674432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135780.277543:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666674432:0@lo:400: 00000100:00100000:0.0:1789135780.277612:0:9526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967a1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1876044666674560:0@lo:901: 00000100:00100000:0.0:1789135780.277645:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.277676:0:9526:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6424000 going to sleep for 11 seconds 00000100:00100000:3.0:1789135780.277728:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674560 00000100:00100000:3.0:1789135780.277732:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674560 00000100:00100000:3.0:1789135780.277788:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789135780.277795:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1876044666674560:12345-0@lo:901: 00000100:00100000:3.0:1789135780.277901:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9679a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1876044666674560:12345-0@lo:901: Request processed in 107us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135780.277906:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789135780.278312:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789135780.278336:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c967a1c0 x1876044666674560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789135796 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135780.278347:0:9526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967a1c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1876044666674560:0@lo:901: 00010000:00010000:1.0:1789135780.285027:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789135780.285224:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789135780.285270:0:9525:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789135780.285284:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x559c8745c6de28b8 00000100:00080000:1.0:1789135780.285295:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135780.285301:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a6c3ba6800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789135780.285338:0:9525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f688a1c0 x1876044666674688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135780.285371:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789135780.286550:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666674688:0@lo:38: 00000100:00100000:0.0:1789135780.286628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135780.286699:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674688 00000100:00100000:0.0:1789135780.286707:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674688 00000100:00100000:0.0:1789135780.286748:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789135780.286755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666674688:12345-0@lo:38: 00010000:00080000:0.0:1789135780.286783:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1789135780.286817:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x559c8745c6de28bf 00000004:00100000:0.0:1789135780.286833:0:6515:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789135780.286883:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135780.286933:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876044666674688:12345-0@lo:38: Request processed in 177us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135780.286941:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789135780.286981:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f688a1c0 x1876044666674688/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789135790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135780.286991:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135780.287000:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789135780.287007:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789135780.287011:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789135780.287014:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba6800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789135780.287020:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666674688:0@lo:38: 00000040:00080000:0.0:1789135780.290038:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789135780.290282:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789135780.290310:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135780.290331:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.290342:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789135780.290406:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789135780.290411:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135780.290413:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135780.290414:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135780.290415:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135780.290417:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135780.290418:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135780.290420:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135780.290421:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135780.290422:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135780.290424:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789135780.290427:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789135780.290429:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789135780.290431:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789135780.290432:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789135780.290433:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789135780.290434:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789135780.290435:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789135780.290436:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789135780.290437:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789135780.290438:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789135780.290438:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789135780.290439:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789135780.290475:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789135780.290493:0:9509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666674816:0@lo:253: 00000100:00100000:2.0:1789135780.290565:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135780.290601:0:9509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135780.290620:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674816 00000100:00100000:2.0:1789135780.290625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674816 00000100:00100000:2.0:1789135780.290660:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789135780.290667:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9509:x1876044666674816:12345-0@lo:253: 20000000:01000000:2.0:1789135780.290689:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789135780.290700:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789135780.295962:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789135780.295981:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789135780.296083:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789135780.296088:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789135780.296115:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.296137:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.296145:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de27fb expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.296152:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.296195:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de27fb expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.296210:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de27fb expref: 17 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.296227:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666674944:0@lo:104: 00000100:00100000:3.0:1789135780.296297:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135780.296357:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.296366:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 17 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.296386:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666675072:0@lo:104: 00000100:00100000:1.0:1789135780.296561:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666674944 00000100:00100000:1.0:1789135780.296568:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666674944 00000100:00100000:1.0:1789135780.296626:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135780.296636:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666674944:12345-0@lo:104: 00010000:00010000:1.0:1789135780.296649:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.296710:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135780.296716:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666674944:12345-0@lo:104: Request processed in 82us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.296725:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1789135780.296748:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135780.296753:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.296760:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135780.296764:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.296773:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135780.296780:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135780.296786:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135780.296830:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.296837:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135780.296884:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.296892:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de27fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2802 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.296905:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.296907:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135780.296909:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135780.296920:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666675200:0@lo:103: 00000100:00100000:1.0:1789135780.296947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.296984:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675200 00000100:00100000:1.0:1789135780.296988:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675200 00010000:00010000:1.0:1789135780.297005:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27fb expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135780.297025:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135780.297031:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3639:x1876044666675200:12345-0@lo:103: 00010000:00010000:1.0:1789135780.297040:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135780.297045:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27fb expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.297055:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de27fb expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135780.297069:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135780.297100:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3639:x1876044666675200:12345-0@lo:103: Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.297107:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135780.297142:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666675200:0@lo:103: 00000100:00100000:3.0:1789135780.297225:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135780.297249:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d1b40 going to sleep for 11 seconds 00010000:00010000:3.0:1789135780.297262:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9fc00/0x559c8745c6de2802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de27fb expref: 17 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.297272:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666674944:0@lo:104: 00000100:00100000:2.0:1789135780.297522:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675072 00000100:00100000:2.0:1789135780.297527:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675072 00000100:00100000:2.0:1789135780.297549:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135780.297556:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666675072:12345-0@lo:104: 00010000:00010000:2.0:1789135780.297574:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297626:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135780.297631:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:6531:x1876044666675072:12345-0@lo:104: Request processed in 76us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.297638:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789135780.297655:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135780.297659:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297666:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135780.297669:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297676:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135780.297682:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135780.297688:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789135780.297717:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297723:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135780.297739:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297746:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de27b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de27bc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297766:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135780.297767:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135780.297769:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135780.297779:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666675328:0@lo:103: 00000100:00100000:2.0:1789135780.297805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135780.297836:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675328 00000100:00100000:2.0:1789135780.297840:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675328 00010000:00010000:2.0:1789135780.297873:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 17 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.297893:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135780.297899:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3640:x1876044666675328:12345-0@lo:103: 00010000:00010000:2.0:1789135780.297907:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135780.297911:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 17 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297920:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 17 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297933:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297940:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789135780.297951:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005572973s 00010000:00010000:2.0:1789135780.297955:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297971:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297978:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297985:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.297990:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dde00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135780.297994:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.298000:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.298008:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135780.298017:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135780.298045:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3640:x1876044666675328:12345-0@lo:103: Request processed in 146us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.298052:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135780.298083:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666675328:0@lo:103: 00010000:00010000:3.0:1789135780.298154:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879400/0x559c8745c6de27bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de27b5 expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135780.298163:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1876044666675072:0@lo:104: 00010000:00010000:3.0:1789135780.298177:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298186:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298191:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135780.298197:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135780.298560:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:9509:x1876044666674816:12345-0@lo:253: Request processed in 7891us (7993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135780.298569:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789135780.302795:0:9509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:44af6ea5-156e-4935-ba38-1972bb1ada25:9509:1876044666674816:0@lo:253: 10000000:01000000:3.0:1789135780.302819:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789135780.302822:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789135780.302824:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789135780.302825:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789135780.302838:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789135780.302840:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789135780.302841:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789135780.302842:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789135780.302844:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789135780.302846:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789135780.302848:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789135780.302850:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789135780.302897:0:9509:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789135780.309065:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789135780.309222:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789135780.309579:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789135780.310116:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789135780.310319:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789135780.310574:0:9509:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789135780.312467:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789135780.322662:0:9509:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789135780.322673:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789135780.322782:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789135780.322822:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789135780.322842:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789135780.323007:0:9509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789135780.327158:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135780.327375:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1789135780.713150:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666675456:0@lo:41: 00000100:00100000:2.0:1789135780.713247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135780.713666:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675456 00000100:00100000:1.0:1789135780.713675:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675456 00000100:00100000:1.0:1789135780.713740:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135780.713750:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666675456:12345-0@lo:41: 00000004:00000024:1.0:1789135780.713791:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789135780.713847:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666675456:12345-0@lo:41: Request processed in 100us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135780.713871:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789135780.713925:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666675456:0@lo:41: 00010000:00010000:0.0:1789135781.032657:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789135781.544789:0:9581:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789135781.545201:0:9581:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789135782.056055:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135783.081367:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135784.111428:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135784.296875:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135784.296907:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666675584:0@lo:41: 00000100:00100000:3.0:1789135784.296990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135784.301466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675584 00000100:00100000:0.0:1789135784.301484:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675584 00000100:00100000:0.0:1789135784.301565:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789135784.301577:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666675584:12345-0@lo:41: 00000004:00000024:0.0:1789135784.301845:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789135784.301962:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666675584:12345-0@lo:41: Request processed in 387us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135784.301970:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135784.302076:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666675584:0@lo:41: 00000100:00100000:0.0:1789135784.809548:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135784.809577:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666675712:0@lo:13: 00000100:00100000:0.0:1789135784.809663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135784.809749:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675712 00000100:00100000:0.0:1789135784.809758:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675712 00000100:00100000:0.0:1789135784.809818:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789135784.809830:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666675712:12345-0@lo:13: 00002000:00000024:0.0:1789135784.809886:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135784.809936:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666675712:12345-0@lo:13: Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135784.809944:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789135784.809966:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135784.810007:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b03c00 x1876044666675712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135784.810025:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666675712:0@lo:13: 00000100:00100000:2.0:1789135784.813498:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135784.813531:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666675840:0@lo:13: 00000100:00100000:2.0:1789135784.813634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135784.813710:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675840 00000100:00100000:2.0:1789135784.813720:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675840 00000100:00100000:2.0:1789135784.813790:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135784.813801:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666675840:12345-0@lo:13: 00002000:00000024:2.0:1789135784.813828:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135784.813907:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666675840:12345-0@lo:13: Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135784.813914:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789135784.813936:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135784.813965:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe2d00 x1876044666675840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135784.814286:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666675840:0@lo:13: 00010000:00010000:0.0:1789135785.131022:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135785.325406:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666675968:0@lo:400: 00000100:00100000:1.0:1789135785.325483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135785.325541:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666676480:0@lo:400: 00000100:00100000:1.0:1789135785.325569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135785.325593:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666676992:0@lo:400: 00000100:00100000:1.0:1789135785.325617:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135785.325646:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789135785.325652:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666676352:0@lo:400: 00000100:00100000:1.0:1789135785.325677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135785.325695:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666676864:0@lo:400: 00000100:00100000:1.0:1789135785.325715:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135785.325743:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676992 00000100:00100000:1.0:1789135785.325751:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676992 00000100:00100000:1.0:1789135785.325805:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676864 00000100:00100000:1.0:1789135785.325808:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676864 00000100:00100000:1.0:1789135785.325831:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135785.325840:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666676992:12345-0@lo:400: 00000100:00100000:1.0:1789135785.325917:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666676992:12345-0@lo:400: Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135785.325925:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789135785.325943:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135785.325949:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666676864:12345-0@lo:400: 00000100:00100000:1.0:1789135785.325974:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666676864:12345-0@lo:400: Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135785.325980:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789135785.325998:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676352 00000100:00100000:1.0:1789135785.326002:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676352 00000100:00100000:1.0:1789135785.326028:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789135785.326034:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666676352:12345-0@lo:400: 00000100:00100000:0.0:1789135785.326517:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666676096:0@lo:400: 00000100:00100000:2.0:1789135785.328326:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666675968 00000100:00100000:2.0:1789135785.328345:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666675968 00000100:00100000:2.0:1789135785.328418:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789135785.328427:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3641:x1876044666675968:12345-0@lo:400: 00000100:00100000:0.0:1789135785.328683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.328718:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666676608:0@lo:400: 00000100:00100000:0.0:1789135785.328745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.328757:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666677120:0@lo:400: 00000100:00100000:0.0:1789135785.328773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.328798:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789135785.328805:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666676224:0@lo:400: 00000100:00100000:0.0:1789135785.328826:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.328840:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666676736:0@lo:400: 00000100:00100000:0.0:1789135785.328875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.328885:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666677248:0@lo:400: 00000100:00100000:0.0:1789135785.328901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135785.328927:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676096 00000100:00100000:0.0:1789135785.328930:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676096 00000100:00100000:0.0:1789135785.328951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676608 00000100:00100000:0.0:1789135785.328953:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676608 00000100:00100000:0.0:1789135785.328972:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677120 00000100:00100000:0.0:1789135785.328974:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677120 00000100:00100000:0.0:1789135785.328984:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676736 00000100:00100000:0.0:1789135785.328986:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676736 00000100:00100000:0.0:1789135785.328997:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677248 00000100:00100000:0.0:1789135785.328999:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677248 00000100:00100000:0.0:1789135785.329010:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135785.329015:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666676096:12345-0@lo:400: 00000100:00100000:0.0:1789135785.329048:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666676096:12345-0@lo:400: Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135785.329054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789135785.329088:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135785.329093:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666676608:12345-0@lo:400: 00000100:00100000:0.0:1789135785.329115:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666676608:12345-0@lo:400: Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135785.329121:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789135785.329129:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135785.329134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666677120:12345-0@lo:400: 00000100:00100000:0.0:1789135785.329239:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666677120:12345-0@lo:400: Request processed in 104us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135785.329246:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135785.329257:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789135785.329263:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666676736:12345-0@lo:400: 00000100:00100000:0.0:1789135785.329283:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666676736:12345-0@lo:400: Request processed in 22us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135785.329289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789135785.329297:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789135785.329302:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666677248:12345-0@lo:400: 00000100:00100000:0.0:1789135785.329321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666677248:12345-0@lo:400: Request processed in 19us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135785.329326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789135785.329361:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3cea1c0 x1876044666676736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.329386:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666676736:0@lo:400: 00010000:00080000:0.0:1789135785.329397:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3cea580 x1876044666677248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.329406:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666677248:0@lo:400: 00010000:00080000:0.0:1789135785.329414:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b00b40 x1876044666676096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.329423:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666676096:0@lo:400: 00010000:00080000:0.0:1789135785.329431:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3cebc00 x1876044666676608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.329450:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666676608:0@lo:400: 00010000:00080000:0.0:1789135785.329459:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ceb840 x1876044666677120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.329466:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666677120:0@lo:400: 00010000:00080000:0.0:1789135785.330465:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b012c0 x1876044666676352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.330480:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666676352:0@lo:400: 00010000:00080000:0.0:1789135785.330494:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ce83c0 x1876044666676864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.330502:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666676864:0@lo:400: 00010000:00080000:0.0:1789135785.330513:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ceb480 x1876044666676992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135785.330521:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666676992:0@lo:400: 00000100:00100000:1.0:1789135785.332309:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666676352:12345-0@lo:400: Request processed in 6263us (6620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135785.332327:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135785.334014:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+15:3641:x1876044666675968:12345-0@lo:400: Request processed in 5577us (8520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135785.334031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789135785.334103:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676480 00000100:00100000:2.0:1789135785.334112:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676480 00000100:00100000:2.0:1789135785.334591:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666676224 00000100:00100000:2.0:1789135785.334596:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666676224 00000100:00100000:2.0:1789135785.334616:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135785.334623:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666676480:12345-0@lo:400: 00000100:00100000:2.0:1789135785.334681:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666676480:12345-0@lo:400: Request processed in 58us (9111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135785.334686:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135785.334700:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135785.334705:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666676224:12345-0@lo:400: 00000100:00100000:2.0:1789135785.334739:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666676224:12345-0@lo:400: Request processed in 34us (5912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135785.334745:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789135785.334850:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135785.334875:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135785.334915:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666676224:0@lo:400: 00000100:00100000:0.0:1789135785.343729:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666675968:0@lo:400: 00000100:00100000:0.0:1789135785.343761:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666676480:0@lo:400: 00000100:00100000:2.0:1789135785.839730:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135785.839760:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666677376:0@lo:41: 00000100:00100000:2.0:1789135785.839832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135785.839959:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677376 00000100:00100000:2.0:1789135785.839967:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677376 00000100:00100000:2.0:1789135785.840016:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135785.840026:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666677376:12345-0@lo:41: 00000004:00000024:2.0:1789135785.840266:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789135785.840319:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666677376:12345-0@lo:41: Request processed in 295us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135785.840327:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789135785.840408:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666677376:0@lo:41: 00010000:00010000:2.0:1789135786.153965:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135787.177382:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135788.200529:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789135788.236723:0:9871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135789.225805:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789135789.298250:0:9923:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135789.298641:0:9923:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789135789.416156:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666677504:0@lo:41: 00000100:00100000:1.0:1789135789.416228:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.416344:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677504 00000100:00100000:0.0:1789135789.416352:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677504 00000100:00100000:0.0:1789135789.416411:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789135789.416430:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666677504:12345-0@lo:41: 00000004:00000024:0.0:1789135789.416469:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789135789.416523:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666677504:12345-0@lo:41: Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.416530:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789135789.416713:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666677504:0@lo:41: 00000100:00100000:1.0:1789135789.931703:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666677632:0@lo:13: 00000100:00100000:1.0:1789135789.931796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.931892:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677632 00000100:00100000:1.0:1789135789.931914:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677632 00000100:00100000:1.0:1789135789.931979:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789135789.931989:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666677632:12345-0@lo:13: 00002000:00000024:1.0:1789135789.932018:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135789.933645:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666677632:12345-0@lo:13: Request processed in 1650us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.933658:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789135789.933706:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135789.933749:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f688b480 x1876044666677632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135789.933772:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666677632:0@lo:13: 00000100:00100000:3.0:1789135789.934238:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135789.934253:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666677760:0@lo:13: 00000100:00100000:3.0:1789135789.934317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789135789.934424:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789135789.934428:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7e761a000 from 39 10000000:01000000:1.0:1789135789.934431:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789135789.934460:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.934470:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.934479:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135789.934493:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666677888:0@lo:101: 00000100:00100000:1.0:1789135789.934877:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.934999:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677888 00000100:00100000:2.0:1789135789.935006:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677888 00000100:00100000:2.0:1789135789.935053:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135789.935077:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666677888:12345-0@lo:101: 00010000:00010000:2.0:1789135789.935093:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135789.935105:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de28cd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.935130:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de28cd expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.935140:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28cd expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.935149:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f200, rc 0) 00000100:00100000:0.0:1789135789.935209:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666677760 00000100:00100000:0.0:1789135789.935214:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666677760 00000100:00100000:0.0:1789135789.935252:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789135789.935259:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666677760:12345-0@lo:13: 00002000:00000024:0.0:1789135789.935273:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135789.935624:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e82600 going to sleep for 11 seconds 00000100:00080000:1.0:1789135789.935637:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135789.935723:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666677888:12345-0@lo:101: Request processed in 662us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.935730:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789135789.935831:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666677888:0@lo:101: 00010000:00010000:1.0:1789135789.935848:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.936071:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135789.936140:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678016:0@lo:501: 00000100:00100000:1.0:1789135789.936173:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.936203:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e82600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.936313:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678016 00000100:00100000:2.0:1789135789.936318:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678016 00000100:00100000:2.0:1789135789.936367:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135789.936374:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666678016:12345-0@lo:501: 00000100:00100000:2.0:1789135789.936501:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666678016:12345-0@lo:501: Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.936508:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789135789.936745:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678016:0@lo:501: 00000100:00100000:1.0:1789135789.936776:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678144:0@lo:503: 00000100:00100000:1.0:1789135789.936819:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.936840:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e82600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.936928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678144 00000100:00100000:2.0:1789135789.936932:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678144 00000100:00100000:2.0:1789135789.936972:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135789.936978:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666678144:12345-0@lo:503: 00000100:00100000:2.0:1789135789.937054:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666678144:12345-0@lo:503: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.937072:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789135789.937243:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678144:0@lo:503: 00000100:00100000:0.0:1789135789.937847:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666677760:12345-0@lo:13: Request processed in 2585us (3526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.937881:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135789.938232:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9954:1876044666678272:0@lo:502: 00000100:00100000:3.0:1789135789.938296:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.938344:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.938447:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678272 00000100:00100000:2.0:1789135789.938454:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678272 00000100:00100000:2.0:1789135789.938493:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135789.938501:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9954:x1876044666678272:12345-0@lo:502: 00000100:00100000:2.0:1789135789.938612:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9954:x1876044666678272:12345-0@lo:502: Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.938619:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789135789.938766:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9954:1876044666678272:0@lo:502: 00000100:00100000:3.0:1789135789.938812:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9954:1876044666678400:0@lo:502: 00000100:00100000:3.0:1789135789.938845:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.938891:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.938942:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678400 00000100:00100000:2.0:1789135789.938947:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678400 00000100:00100000:2.0:1789135789.938980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789135789.938986:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9954:x1876044666678400:12345-0@lo:502: 00000100:00100000:3.0:1789135789.939163:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9954:1876044666678400:0@lo:502: 00000040:00080000:3.0:1789135789.939185:0:9954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:2.0:1789135789.940172:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:9954:x1876044666678400:12345-0@lo:502: Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.940187:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000020:01000000:2.0:1789135789.940245:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789135789.940274:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135789.940296:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.940310:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135789.940330:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789135789.940342:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789135789.940345:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135789.940376:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.940384:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.940394:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.940410:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678528:0@lo:101: 00000100:00100000:2.0:1789135789.940451:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.940476:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.940668:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678528 00000100:00100000:3.0:1789135789.940675:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678528 00000100:00100000:3.0:1789135789.940715:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789135789.940724:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666678528:12345-0@lo:101: 00010000:00010000:3.0:1789135789.940736:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135789.940747:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de28db expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.940770:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de28db expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.940780:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28db expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.940788:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a8021dd400, rc 0) 00000100:00100000:3.0:1789135789.940828:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666678528:12345-0@lo:101: Request processed in 105us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.940833:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789135789.940891:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678528:0@lo:101: 00010000:00010000:3.0:1789135789.940911:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.940920:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.940972:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678656:0@lo:501: 00000100:00100000:3.0:1789135789.940999:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.941015:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.941027:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678656 00000100:00100000:3.0:1789135789.941030:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678656 00000100:00100000:3.0:1789135789.941051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789135789.941057:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666678656:12345-0@lo:501: 00000100:00100000:3.0:1789135789.941250:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666678656:12345-0@lo:501: Request processed in 191us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.941259:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789135789.941312:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678656:0@lo:501: 00010000:00080000:1.0:1789135789.942227:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe30c0 x1876044666677760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135789.942256:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666677760:0@lo:13: 00000100:00100000:3.0:1789135789.942434:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678784:0@lo:503: 00000100:00100000:3.0:1789135789.942498:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.942656:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.951685:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678784 00000100:00100000:2.0:1789135789.951699:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678784 00000100:00100000:3.0:1789135789.961699:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789135789.961715:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666678784:12345-0@lo:503: 00000100:00100000:3.0:1789135789.961927:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666678784:12345-0@lo:503: Request processed in 215us (19428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.961935:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789135789.961998:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666678784:0@lo:503: 00000100:00100000:1.0:1789135789.972626:0:9955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9955:1876044666678912:0@lo:502: 00000100:00100000:1.0:1789135789.972727:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.972844:0:9955:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.973216:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666678912 00000100:00100000:2.0:1789135789.973224:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666678912 00000100:00100000:3.0:1789135789.973479:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789135789.973490:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9955:x1876044666678912:12345-0@lo:502: 00000100:00100000:3.0:1789135789.973646:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9955:x1876044666678912:12345-0@lo:502: Request processed in 157us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.973654:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789135789.973738:0:9955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9955:1876044666678912:0@lo:502: 00000020:01000000:1.0:1789135789.973771:0:9955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135789.973781:0:9955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.973784:0:9955:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135789.973789:0:9955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135789.973791:0:9955:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789135789.973815:0:9955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9955:1876044666679040:0@lo:502: 00000100:00100000:1.0:1789135789.973924:0:9955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.974346:0:9955:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135789.974439:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679040 00000100:00100000:0.0:1789135789.974445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679040 00000100:00100000:0.0:1789135789.974476:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789135789.974495:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9955:x1876044666679040:12345-0@lo:502: 00000100:00100000:0.0:1789135789.974603:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:9955:x1876044666679040:12345-0@lo:502: Request processed in 107us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135789.974610:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789135789.974735:0:9955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9955:1876044666679040:0@lo:502: 00000020:01000000:1.0:1789135789.974760:0:9955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135789.974765:0:9955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135789.974767:0:9955:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789135789.974772:0:9955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789135789.975049:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789135789.975081:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789135789.975091:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.975101:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135789.975111:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789135789.975113:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7fa5f7000 from 39 10000000:01000000:0.0:1789135789.975116:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789135789.975154:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.975161:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.975171:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.975185:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679168:0@lo:101: 00000100:00100000:0.0:1789135789.975216:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.975251:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.975417:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679168 00000100:00100000:1.0:1789135789.975422:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679168 00000100:00100000:1.0:1789135789.975444:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135789.975450:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666679168:12345-0@lo:101: 00010000:00010000:1.0:1789135789.975459:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135789.975470:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de28e9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.975489:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.975500:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135789.975508:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879600, rc 0) 00000100:00100000:1.0:1789135789.975553:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666679168:12345-0@lo:101: Request processed in 102us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.975559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789135789.975688:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679168:0@lo:101: 00010000:00010000:0.0:1789135789.975701:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135789.975710:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135789.975759:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679296:0@lo:501: 00000100:00100000:0.0:1789135789.975782:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.975804:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.976028:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679296 00000100:00100000:1.0:1789135789.976034:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679296 00000100:00100000:1.0:1789135789.976072:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789135789.976081:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666679296:12345-0@lo:501: 00000100:00100000:1.0:1789135789.976214:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666679296:12345-0@lo:501: Request processed in 133us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.976223:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789135789.976461:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679296:0@lo:501: 00000100:00100000:0.0:1789135789.976493:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679424:0@lo:503: 00000100:00100000:0.0:1789135789.976602:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.976635:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.976685:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679424 00000100:00100000:1.0:1789135789.976689:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679424 00000100:00100000:1.0:1789135789.976708:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789135789.976713:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666679424:12345-0@lo:503: 00000100:00100000:1.0:1789135789.976846:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666679424:12345-0@lo:503: Request processed in 131us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.976886:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789135789.977212:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679424:0@lo:503: 00000100:00100000:3.0:1789135789.977735:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9956:1876044666679552:0@lo:502: 00000100:00100000:3.0:1789135789.977782:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.977887:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.978140:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679552 00000100:00100000:1.0:1789135789.978146:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679552 00000100:00100000:1.0:1789135789.978214:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789135789.978222:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:9956:x1876044666679552:12345-0@lo:502: 00000100:00100000:1.0:1789135789.978410:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:9956:x1876044666679552:12345-0@lo:502: Request processed in 187us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.978418:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789135789.978495:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9956:1876044666679552:0@lo:502: 00000100:00100000:3.0:1789135789.978552:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9956:1876044666679680:0@lo:502: 00000100:00100000:3.0:1789135789.978584:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.978714:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d0e1a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.978783:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679680 00000100:00100000:2.0:1789135789.978787:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679680 00000100:00100000:2.0:1789135789.978811:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789135789.978818:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:9956:x1876044666679680:12345-0@lo:502: 00000100:00100000:2.0:1789135789.978923:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:9956:x1876044666679680:12345-0@lo:502: Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.978931:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789135789.979005:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9956:1876044666679680:0@lo:502: 00000040:00080000:3.0:1789135789.979023:0:9956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789135789.979294:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789135789.979327:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135789.979338:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.979361:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135789.979370:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789135789.979373:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa5f7000 from 6 10000000:01000000:2.0:1789135789.979376:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789135789.979402:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.979409:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.979419:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.979431:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679808:0@lo:101: 00000100:00100000:2.0:1789135789.979459:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.979490:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.979643:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679808 00000100:00100000:3.0:1789135789.979648:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679808 00000100:00100000:3.0:1789135789.979669:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789135789.979675:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666679808:12345-0@lo:101: 00010000:00010000:3.0:1789135789.979683:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135789.979694:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de28f7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.979713:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de28f7 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.979722:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28f7 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.979737:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a8021dde00, rc 0) 00000100:00100000:3.0:1789135789.979774:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666679808:12345-0@lo:101: Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.979780:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789135789.979846:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679808:0@lo:101: 00010000:00010000:2.0:1789135789.979893:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.979903:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.979943:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679936:0@lo:256: 00000100:00100000:2.0:1789135789.979971:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.979990:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.980054:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666679936 00000100:00100000:3.0:1789135789.980068:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666679936 00000100:00100000:3.0:1789135789.980086:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789135789.980095:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666679936:12345-0@lo:256: 20000000:01000000:3.0:1789135789.980109:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789135789.980126:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789135789.980129:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789135789.980224:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666679936:12345-0@lo:256: Request processed in 128us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.980230:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789135789.980473:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666679936:0@lo:256: 10000000:01000000:2.0:1789135789.980594:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789135789.980602:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.980610:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135789.980618:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789135789.980621:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789135789.980623:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789135789.980641:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.980648:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.980656:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.980668:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666680064:0@lo:101: 00000100:00100000:2.0:1789135789.980694:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.980720:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.980763:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680064 00000100:00100000:3.0:1789135789.980767:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680064 00000100:00100000:3.0:1789135789.980787:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789135789.980792:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666680064:12345-0@lo:101: 00010000:00010000:3.0:1789135789.980799:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135789.980808:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2905 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.980835:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2905 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.980845:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2905 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.980889:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a8021dc200, rc 0) 00000100:00100000:3.0:1789135789.980921:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666680064:12345-0@lo:101: Request processed in 128us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.980927:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789135789.981063:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666680064:0@lo:101: 00010000:00010000:2.0:1789135789.981085:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135789.981093:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135789.981147:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666680192:0@lo:501: 00000100:00100000:2.0:1789135789.981174:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.981196:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.981301:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680192 00000100:00100000:3.0:1789135789.981306:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680192 00000100:00100000:3.0:1789135789.981337:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135789.981360:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666680192:12345-0@lo:501: 00000100:00100000:3.0:1789135789.981472:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666680192:12345-0@lo:501: Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.981480:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789135789.981988:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666680192:0@lo:501: 00000100:00100000:2.0:1789135789.982021:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666680320:0@lo:503: 00000100:00100000:2.0:1789135789.982076:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.982097:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.982201:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680320 00000100:00100000:3.0:1789135789.982207:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680320 00000100:00100000:3.0:1789135789.982230:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135789.982236:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666680320:12345-0@lo:503: 00000100:00100000:3.0:1789135789.982355:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666680320:12345-0@lo:503: Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.982362:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789135789.982494:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666680320:0@lo:503: 00000100:00100000:0.0:1789135789.984891:0:9957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9957:1876044666680448:0@lo:502: 00000100:00100000:0.0:1789135789.984992:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135789.985043:0:9957:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135789.985272:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680448 00000100:00100000:1.0:1789135789.985280:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680448 00000100:00100000:1.0:1789135789.985343:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789135789.985352:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:9957:x1876044666680448:12345-0@lo:502: 00000100:00100000:1.0:1789135789.985500:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:9957:x1876044666680448:12345-0@lo:502: Request processed in 149us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.985508:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789135789.985778:0:9957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9957:1876044666680448:0@lo:502: 00000020:01000000:2.0:1789135789.985817:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789135789.985842:0:9957:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789135789.985873:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135789.985877:0:9957:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789135789.985885:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789135789.985888:0:9957:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:2.0:1789135789.985913:0:9957:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789135789.985915:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789135789.985930:0:9957:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90a6c2b91a48) 00000020:00000080:2.0:1789135789.985954:0:9957:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789135789.985958:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789135789.986084:0:9957:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789135789.986092:0:9957:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789135789.986100:0:9957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de291a 00010000:00080000:2.0:1789135789.986145:0:9957:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2e9c000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789135789.986799:0:9957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789135789.987252:0:9957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789135789.987264:0:9957:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789135789.987695:0:9957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789135789.987823:0:9957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135789.989729:0:9957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789135789.990050:0:9957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789135789.990687:0:9958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135789.990693:0:9958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789135789.992144:0:9957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789135789.992161:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789135789.992210:0:9957:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789135789.992236:0:9957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de2921 00000100:00080000:3.0:1789135789.992246:0:9957:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789135789.992252:0:9957:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2e9c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789135789.992312:0:9957:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3b8c3c0 x1876044666680576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789135789.992447:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666680576:0@lo:8: 00000100:00100000:0.0:1789135789.992594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135789.992689:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680576 00000100:00100000:1.0:1789135789.992697:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680576 00000100:00100000:1.0:1789135789.992746:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789135789.992761:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666680576:12345-0@lo:8: 00010000:00080000:1.0:1789135789.992789:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789135789.992813:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de2928 00002000:00100000:1.0:1789135789.992839:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90a6c3ba7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789135789.992844:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789135789.992848:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789135789.992933:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789135789.993142:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789135789.993165:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba1000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789135789.993302:0:9957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789135789.993381:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135789.993387:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135789.993389:0:9957:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789135789.993392:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135789.993396:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135789.993397:0:9957:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789135789.993399:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789135789.993401:0:9957:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789135789.993428:0:9957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9957:1876044666680704:0@lo:502: 00000100:00100000:3.0:1789135789.993480:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.993512:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680704 00000100:00100000:2.0:1789135789.993717:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666680832:0@lo:400: 00000100:00100000:2.0:1789135789.993754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.993777:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666681344:0@lo:400: 00000100:00100000:2.0:1789135789.993799:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.993820:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135789.993827:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666680960:0@lo:400: 00000100:00100000:2.0:1789135789.993874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.993894:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666681472:0@lo:400: 00000100:00100000:2.0:1789135789.993917:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.993946:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666681088:0@lo:400: 00000100:00100000:2.0:1789135789.993971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.993989:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666681600:0@lo:400: 00000100:00100000:2.0:1789135789.994021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.994033:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789135789.994038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666681216:0@lo:400: 00000100:00100000:2.0:1789135789.994057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.994073:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666681728:0@lo:400: 00000100:00100000:2.0:1789135789.994114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.994138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680832 00000100:00100000:2.0:1789135789.994142:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680832 00000100:00100000:2.0:1789135789.994173:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681344 00000100:00100000:2.0:1789135789.994175:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681344 00000100:00100000:2.0:1789135789.994194:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681472 00000100:00100000:2.0:1789135789.994203:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681472 00000100:00100000:2.0:1789135789.994220:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681088 00000100:00100000:2.0:1789135789.994222:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681088 00000100:00100000:2.0:1789135789.994231:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681600 00000100:00100000:2.0:1789135789.994232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681600 00000100:00100000:2.0:1789135789.994242:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681728 00000100:00100000:2.0:1789135789.994244:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681728 00000100:00100000:2.0:1789135789.994257:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789135789.994264:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666680832:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994325:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666680832:12345-0@lo:400: Request processed in 61us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994333:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789135789.994349:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789135789.994354:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666681344:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994380:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666681344:12345-0@lo:400: Request processed in 27us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994385:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789135789.994394:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789135789.994400:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666681472:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994423:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666681472:12345-0@lo:400: Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789135789.994439:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135789.994444:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666681088:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994473:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666681088:12345-0@lo:400: Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994480:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135789.994491:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135789.994504:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666681600:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994545:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666681600:12345-0@lo:400: Request processed in 42us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994551:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135789.994563:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135789.994569:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2312940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666681728:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994596:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2312940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666681728:12345-0@lo:400: Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994602:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789135789.994629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666680960 00000100:00100000:2.0:1789135789.994633:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680960 00000100:00100000:2.0:1789135789.994658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681216 00000100:00100000:2.0:1789135789.994661:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681216 00000100:00100000:2.0:1789135789.994674:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135789.994680:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666680960:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994710:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666680960:12345-0@lo:400: Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994715:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789135789.994729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789135789.994735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666681216:12345-0@lo:400: 00000100:00100000:2.0:1789135789.994760:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666681216:12345-0@lo:400: Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.994765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789135789.994787:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135789.994790:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135789.994824:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666681216:0@lo:400: 00010000:00080000:2.0:1789135789.994837:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe3840 x1876044666681728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.994874:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666681728:0@lo:400: 00010000:00080000:2.0:1789135789.994889:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe30c0 x1876044666681088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.994896:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666681088:0@lo:400: 00010000:00080000:2.0:1789135789.994904:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe1680 x1876044666681600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.994911:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666681600:0@lo:400: 00000100:00100000:2.0:1789135789.994944:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666680960:0@lo:400: 00010000:00080000:2.0:1789135789.994953:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe2940 x1876044666681472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.994959:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666681472:0@lo:400: 00010000:00080000:2.0:1789135789.994967:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe0780 x1876044666680832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.994974:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666680832:0@lo:400: 00010000:00080000:2.0:1789135789.994983:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe2d00 x1876044666681344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135789.994990:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666681344:0@lo:400: 00000100:00100000:2.0:1789135789.995113:0:9957:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c10866c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.995389:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666680704 00000100:00100000:3.0:1789135789.995430:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789135789.995437:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:9957:x1876044666680704:12345-0@lo:502: 00000100:00100000:3.0:1789135789.995665:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:9957:x1876044666680704:12345-0@lo:502: Request processed in 228us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.995673:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789135789.995962:0:9957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9957:1876044666680704:0@lo:502: 00000020:01000000:2.0:1789135789.995995:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135789.996003:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135789.996010:0:9957:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789135789.996016:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:3.0:1789135789.996259:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789135789.996291:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789135789.996303:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996316:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135789.996335:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789135789.996345:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7d26b4800 from 39 10000000:01000000:3.0:1789135789.996348:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789135789.996383:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996391:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996401:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.996421:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666681856:0@lo:101: 00000100:00100000:3.0:1789135789.996461:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.996492:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.996508:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681856 00000100:00100000:3.0:1789135789.996513:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681856 00000100:00100000:3.0:1789135789.996684:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789135789.996692:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666681856:12345-0@lo:101: 00010000:00010000:3.0:1789135789.996703:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135789.996716:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de292f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996739:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de292f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996751:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de292f expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996759:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a802045200, rc 0) 00000100:00100000:3.0:1789135789.996793:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666681856:12345-0@lo:101: Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.996806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789135789.996947:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666681856:0@lo:101: 00010000:00010000:3.0:1789135789.996959:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135789.996968:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135789.997014:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666681984:0@lo:501: 00000100:00100000:3.0:1789135789.997036:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.997048:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135789.997155:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666681984 00000100:00100000:2.0:1789135789.997160:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666681984 00000100:00100000:2.0:1789135789.997186:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789135789.997192:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666681984:12345-0@lo:501: 00000100:00100000:2.0:1789135789.997298:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666681984:12345-0@lo:501: Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135789.997305:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789135789.997418:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666681984:0@lo:501: 00000100:00100000:3.0:1789135789.997442:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682112:0@lo:503: 00000100:00100000:3.0:1789135789.997478:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135789.997498:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.997508:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682112 00000100:00100000:3.0:1789135789.997511:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682112 00000100:00100000:3.0:1789135789.997635:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789135789.997642:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666682112:12345-0@lo:503: 00000100:00100000:3.0:1789135789.997720:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666682112:12345-0@lo:503: Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.997727:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789135789.997757:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682112:0@lo:503: 00000100:00100000:1.0:1789135789.998298:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666680576:12345-0@lo:8: Request processed in 5525us (5691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135789.998308:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789135789.998943:0:9960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9960:1876044666682240:0@lo:502: 00000100:00100000:2.0:1789135789.999001:0:9960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.999039:0:9960:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.999202:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682240 00000100:00100000:3.0:1789135789.999208:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682240 00000100:00100000:3.0:1789135789.999255:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789135789.999262:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:9960:x1876044666682240:12345-0@lo:502: 00000100:00100000:3.0:1789135789.999384:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:9960:x1876044666682240:12345-0@lo:502: Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.999391:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789135789.999670:0:9960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9960:1876044666682240:0@lo:502: 00000100:00100000:2.0:1789135789.999716:0:9960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9960:1876044666682368:0@lo:502: 00000100:00100000:2.0:1789135789.999749:0:9960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135789.999781:0:9960:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789135789.999822:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682368 00000100:00100000:3.0:1789135789.999836:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682368 00000100:00100000:3.0:1789135789.999890:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789135789.999897:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:9960:x1876044666682368:12345-0@lo:502: 00000100:00100000:3.0:1789135789.999972:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:9960:x1876044666682368:12345-0@lo:502: Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135789.999979:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789135790.000112:0:9960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9960:1876044666682368:0@lo:502: 00000040:00080000:2.0:1789135790.000130:0:9960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789135790.000306:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789135790.000341:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789135790.000352:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135790.000363:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135790.000372:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789135790.000374:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d26b4800 from 6 10000000:01000000:1.0:1789135790.000377:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789135790.000402:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135790.000410:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135790.000429:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135790.000442:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682496:0@lo:101: 00000100:00100000:1.0:1789135790.000472:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.000503:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e82600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135790.000818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682496 00000100:00100000:2.0:1789135790.000832:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682496 00000100:00100000:2.0:1789135790.000894:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789135790.000902:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666682496:12345-0@lo:101: 00010000:00010000:2.0:1789135790.000912:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135790.000925:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de2944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de293d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.000948:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de2944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de293d expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.000966:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de2944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de293d expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.000976:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e800, rc 0) 00000100:00100000:2.0:1789135790.001009:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666682496:12345-0@lo:101: Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.001016:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789135790.001049:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682496:0@lo:101: 00010000:00010000:2.0:1789135790.001072:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001082:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135790.001125:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682624:0@lo:256: 00000100:00100000:2.0:1789135790.001155:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.001169:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135790.001181:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682624 00000100:00100000:2.0:1789135790.001184:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682624 00000100:00100000:2.0:1789135790.001205:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789135790.001210:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666682624:12345-0@lo:256: 20000000:01000000:2.0:1789135790.001225:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789135790.001242:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789135790.001245:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789135790.001358:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666682624:12345-0@lo:256: Request processed in 147us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.001367:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789135790.001403:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682624:0@lo:256: 10000000:01000000:2.0:1789135790.001448:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789135790.001454:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001461:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135790.001468:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789135790.001471:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789135790.001473:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135790.001488:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001495:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001503:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135790.001515:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682752:0@lo:101: 00000100:00100000:2.0:1789135790.001815:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.001843:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135790.001884:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682752 00000100:00100000:2.0:1789135790.001889:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682752 00000100:00100000:2.0:1789135790.001915:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789135790.001921:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666682752:12345-0@lo:101: 00010000:00010000:2.0:1789135790.001930:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135790.001939:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de294b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001968:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de294b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001978:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de294b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.001986:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e000, rc 0) 00000100:00100000:2.0:1789135790.002017:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666682752:12345-0@lo:101: Request processed in 96us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.002023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789135790.002128:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682752:0@lo:101: 00010000:00010000:2.0:1789135790.002141:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135790.002150:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135790.002201:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682880:0@lo:501: 00000100:00100000:2.0:1789135790.002225:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.002243:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135790.002502:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666682880 00000100:00100000:1.0:1789135790.002507:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666682880 00000100:00100000:1.0:1789135790.002549:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789135790.002556:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666682880:12345-0@lo:501: 00000100:00100000:1.0:1789135790.002668:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666682880:12345-0@lo:501: Request processed in 113us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135790.002675:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789135790.002988:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666682880:0@lo:501: 00000100:00100000:2.0:1789135790.003015:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666683008:0@lo:503: 00000100:00100000:2.0:1789135790.003070:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.003101:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.003331:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683008 00000100:00100000:3.0:1789135790.003337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683008 00000100:00100000:3.0:1789135790.003368:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789135790.003376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666683008:12345-0@lo:503: 00000100:00100000:3.0:1789135790.003476:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666683008:12345-0@lo:503: Request processed in 100us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.003483:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789135790.003679:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666683008:0@lo:503: 00000100:00100000:2.0:1789135790.004154:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9961:1876044666683136:0@lo:502: 00000100:00100000:2.0:1789135790.004193:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.004228:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.004427:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683136 00000100:00100000:3.0:1789135790.004433:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683136 00000100:00100000:3.0:1789135790.004471:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789135790.004478:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:9961:x1876044666683136:12345-0@lo:502: 00000100:00100000:3.0:1789135790.004584:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:9961:x1876044666683136:12345-0@lo:502: Request processed in 106us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.004591:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789135790.004729:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9961:1876044666683136:0@lo:502: 00000020:01000000:2.0:1789135790.004754:0:9961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789135790.004762:0:9961:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789135790.004769:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135790.004772:0:9961:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789135790.004778:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789135790.004782:0:9961:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:2.0:1789135790.004805:0:9961:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789135790.004808:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789135790.004830:0:9961:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a6c2b90000) 00000020:00000080:2.0:1789135790.004891:0:9961:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789135790.004898:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789135790.004992:0:9961:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789135790.004998:0:9961:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789135790.005014:0:9961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de2960 00010000:00080000:2.0:1789135790.005047:0:9961:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c3dd5000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789135790.005310:0:9961:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789135790.005714:0:9961:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789135790.005727:0:9961:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00010000:00080000:0.0:1789135790.005958:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8c3c0 x1876044666680576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135790.005971:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135790.005980:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789135790.005988:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789135790.005992:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789135790.005996:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2e9c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789135790.006021:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789135790.006027:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666680576:0@lo:8: 00000100:00100000:1.0:1789135790.006230:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666683264:0@lo:700: 00000100:00100000:1.0:1789135790.006305:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.006345:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d6029180 going to sleep for 11 seconds 00000004:00080000:3.0:1789135790.006652:0:9958:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789135790.006719:0:9958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 238125863969ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789135790.006726:0:9958:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789135790.006989:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683264 00000100:00100000:0.0:1789135790.006996:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683264 00000100:00100000:0.0:1789135790.007141:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789135790.007152:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9959:x1876044666683264:12345-0@lo:700: 00000100:00100000:0.0:1789135790.007196:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1876044666683392:0@lo:700: 00000100:00100000:0.0:1789135790.007234:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135790.007255:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135790.007270:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683392 00000100:00100000:0.0:1789135790.007274:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683392 00000100:00100000:0.0:1789135790.007314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789135790.007412:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135790.008444:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1876044666683392:12345-0@lo:700: 00000040:00080000:0.0:1789135790.011240:0:9961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789135790.015126:0:7447:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:2.0:1789135790.020735:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:0.0:1789135790.022844:0:9961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789135790.023012:0:9961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789135790.023144:0:9961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789135790.025477:0:9963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135790.025484:0:9963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789135790.035274:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1876044666683392:12345-0@lo:700: Request processed in 27944us (28029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.035303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:1.0:1789135790.035893:0:9961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789135790.035907:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789135790.035958:0:9961:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789135790.035984:0:9961:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de2967 00000100:00080000:1.0:1789135790.035993:0:9961:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789135790.035999:0:9961:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c3dd5000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789135790.036045:0:9961:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7d55afc00 x1876044666683520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789135790.036634:0:9961:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789135790.036702:0:9961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135790.036707:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135790.036709:0:9961:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789135790.036712:0:9961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135790.036716:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135790.036718:0:9961:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789135790.036720:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789135790.036722:0:9961:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789135790.036756:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9961:1876044666683648:0@lo:502: 00000100:00100000:1.0:1789135790.036830:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.036900:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135790.036929:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683648 00000100:00100000:1.0:1789135790.036934:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683648 00000100:00100000:1.0:1789135790.036983:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789135790.036993:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:9961:x1876044666683648:12345-0@lo:502: 00000100:00100000:0.0:1789135790.037200:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666683520:0@lo:8: 00000100:00100000:0.0:1789135790.037246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135790.037271:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683520 00000100:00100000:0.0:1789135790.037275:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683520 00000100:00100000:0.0:1789135790.038055:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789135790.038141:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1876044666683520:12345-0@lo:8: 00010000:00080000:0.0:1789135790.038185:0:8429:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1789135790.038213:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de296e 00002000:00100000:0.0:1789135790.038227:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a6c3a2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789135790.038232:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789135790.038234:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1789135790.038425:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3cebc00 x1876044666683392/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135790.038450:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1876044666683392:0@lo:700: 40000000:02000000:2.0:1789135790.038461:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00002000:00080000:0.0:1789135790.038626:0:8429:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789135790.038652:0:8429:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135790.038708:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666683520:12345-0@lo:8: Request processed in 567us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135790.038715:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789135790.038774:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55afc00 x1876044666683520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789135800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135790.038783:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789135790.038789:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789135790.038796:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789135790.038807:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789135790.038810:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3dd5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789135790.038819:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789135790.038825:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666683520:0@lo:8: 00000004:00080000:0.0:1789135790.038876:0:9963:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789135790.038928:0:9963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238158072486ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789135790.038934:0:9963:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789135790.039670:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:9961:x1876044666683648:12345-0@lo:502: Request processed in 2675us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135790.039681:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135790.040436:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:9961:1876044666683648:0@lo:502: 00000020:01000000:0.0:1789135790.041751:0:9961:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135790.041762:0:9961:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135790.041765:0:9961:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789135790.041771:0:9961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789135790.042334:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789135790.042360:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789135790.042372:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135790.042383:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135790.042394:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789135790.042396:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a7efa18000 from 1 10000000:01000000:3.0:1789135790.042399:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789135790.042435:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135790.042444:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135790.042456:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135790.042480:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666683776:0@lo:101: 00000100:00100000:3.0:1789135790.043647:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135790.043700:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54a0c0 going to sleep for 11 seconds 00000004:00080000:1.0:1789135790.045742:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789135790.045893:0:9964:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789135790.045923:0:9964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666684032:0@lo:7: 00000100:00100000:3.0:1789135790.045997:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135790.046023:0:9964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135790.046523:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135790.046541:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666683904:0@lo:13: 00000100:00100000:1.0:1789135790.046587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135790.047452:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683776 00000100:00100000:0.0:1789135790.047461:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683776 00000100:00100000:0.0:1789135790.048426:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135790.048457:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666683776:12345-0@lo:101: 00010000:00010000:0.0:1789135790.048477:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135790.048498:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2975 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135790.048542:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2975 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135790.048555:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2975 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135790.048564:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030a00, rc 0) 00000100:00100000:0.0:1789135790.048649:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666683776:12345-0@lo:101: Request processed in 205us (5010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135790.048672:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135790.048739:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666683776:0@lo:101: 00010000:00010000:0.0:1789135790.048757:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135790.048767:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135790.048844:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666684160:0@lo:501: 00000100:00100000:0.0:1789135790.048895:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135790.048940:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23000 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.049110:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666683904 00000100:00100000:3.0:1789135790.049121:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666683904 00000100:00100000:3.0:1789135790.049174:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135790.049181:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666683904:12345-0@lo:13: 00002000:00000024:3.0:1789135790.049201:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1789135790.049245:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666683904:12345-0@lo:13: Request processed in 65us (2658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.049251:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135790.049270:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684160 00000100:00100000:3.0:1789135790.049274:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684160 00000100:00100000:3.0:1789135790.049309:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789135790.049316:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666684160:12345-0@lo:501: 00000100:00100000:3.0:1789135790.049408:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666684160:12345-0@lo:501: Request processed in 92us (512us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135790.049416:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789135790.049454:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666684160:0@lo:501: 10000000:01000000:3.0:1789135790.049483:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789135790.049491:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135790.049499:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789135790.049709:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e580 x1876044666683904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135790.049729:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666683904:0@lo:13: 00000100:00080000:0.0:1789135790.052454:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135790.055993:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684032 00000100:00100000:3.0:1789135790.056011:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684032 00000100:00100000:3.0:1789135790.056093:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789135790.056105:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9964:x1876044666684032:12345-0@lo:7: 00000001:00100000:2.0:1789135790.063442:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789135790.063454:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789135790.076810:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9959:x1876044666683264:12345-0@lo:700: Request processed in 69651us (70495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.076838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789135790.078586:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e9a40 x1876044666683264/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135790.078605:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666683264:0@lo:700: 00000004:00080000:2.0:1789135790.090666:0:9959:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789135790.090699:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666684416:0@lo:7: 00000100:00100000:2.0:1789135790.090776:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.090832:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135790.090850:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666684288:0@lo:13: 00000100:00100000:2.0:1789135790.090896:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.090936:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684416 00000100:00100000:2.0:1789135790.090943:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684416 00000100:00100000:2.0:1789135790.090984:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135790.090992:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9959:x1876044666684416:12345-0@lo:7: 00000100:00100000:2.0:1789135790.091047:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684288 00000100:00100000:2.0:1789135790.091051:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684288 00002000:00080000:3.0:1789135790.093959:0:8536:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789135790.093968:0:8536:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789135790.094057:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9964:x1876044666684032:12345-0@lo:7: Request processed in 37950us (48055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.094067:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135790.094298:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135790.094309:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876044666684288:12345-0@lo:13: 00002000:00000024:2.0:1789135790.094468:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789135790.094511:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876044666684288:12345-0@lo:13: Request processed in 205us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.094518:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789135790.094570:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2313c00 x1876044666684288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135790.094592:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2313c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666684288:0@lo:13: 00010000:00080000:1.0:1789135790.098353:0:9964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8d2c0 x1876044666684032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135790.098373:0:9964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8d2c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666684032:0@lo:7: 00000004:00080000:1.0:1789135790.098390:0:9964:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789135790.098433:0:9964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666684544:0@lo:5: 00000100:00100000:1.0:1789135790.098495:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.098532:0:9964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135790.100230:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684544 00000100:00100000:0.0:1789135790.100245:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684544 00000100:00100000:0.0:1789135790.101337:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789135790.101352:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9964:x1876044666684544:12345-0@lo:5: 00002000:00080000:0.0:1789135790.101386:0:8432:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789135790.101390:0:8432:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1789135790.105803:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789135790.105812:0:8429:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789135790.105932:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9959:x1876044666684416:12345-0@lo:7: Request processed in 14935us (15149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.105944:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789135790.106572:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9964:x1876044666684544:12345-0@lo:5: Request processed in 5222us (8074us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789135790.106581:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789135790.106721:0:9964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6609a40 x1876044666684544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135790.106739:0:9964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666684544:0@lo:5: 00000004:00080000:1.0:1789135790.106753:0:9964:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789135790.106793:0:9964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666684672:0@lo:700: 00000100:00100000:1.0:1789135790.106829:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.106875:0:9964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.108229:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684672 00000100:00100000:3.0:1789135790.108238:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684672 00000100:00100000:3.0:1789135790.108296:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135790.108306:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9964:x1876044666684672:12345-0@lo:700: 00010000:00080000:2.0:1789135790.109198:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe2d00 x1876044666684416/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135790.109215:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666684416:0@lo:7: 00000004:00080000:2.0:1789135790.109229:0:9959:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789135790.109265:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666684800:0@lo:5: 00000100:00100000:2.0:1789135790.109409:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.109442:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.109626:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684800 00000100:00100000:3.0:1789135790.109632:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684800 00000100:00100000:3.0:1789135790.109672:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135790.109679:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9959:x1876044666684800:12345-0@lo:5: 00002000:00080000:3.0:1789135790.109705:0:8536:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789135790.109750:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9959:x1876044666684800:12345-0@lo:5: Request processed in 71us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.109757:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789135790.109954:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe2d00 x1876044666684800/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135790.109965:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666684800:0@lo:5: 00000004:00080000:3.0:1789135790.109974:0:9959:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789135790.110000:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666684928:0@lo:5: 00000100:00100000:3.0:1789135790.110027:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135790.110043:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.112204:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666684928 00000100:00100000:3.0:1789135790.112225:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666684928 00000100:00100000:3.0:1789135790.112291:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135790.112303:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9959:x1876044666684928:12345-0@lo:5: 00002000:00080000:3.0:1789135790.113822:0:8429:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789135790.122940:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9959:x1876044666684928:12345-0@lo:5: Request processed in 10631us (12903us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789135790.122956:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789135790.123072:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8cb40 x1876044666684928/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135790.123093:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9959:1876044666684928:0@lo:5: 00000004:00080000:3.0:1789135790.123111:0:9959:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789135790.123160:0:9959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9959:1876044666685056:0@lo:900: 00000100:00100000:3.0:1789135790.123201:0:9959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135790.123230:0:9959:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135790.123248:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685056 00000100:00100000:3.0:1789135790.123255:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685056 00000001:00080000:2.0:1789135790.124374:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789135790.124482:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9964:x1876044666684672:12345-0@lo:700: Request processed in 16174us (17649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.124492:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789135790.124554:0:9964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6608f00 x1876044666684672/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135790.124565:0:9964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789135790.124579:0:9964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666684672:0@lo:700: 00000004:02000040:2.0:1789135790.126212:0:9964:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1789135790.127732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789135790.127757:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9959:x1876044666685056:12345-0@lo:900: 00000100:00100000:3.0:1789135790.127889:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9959:x1876044666685056:12345-0@lo:900: Request processed in 143us (4686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135790.127898:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789135790.127950:0:9959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e580 x1876044666685056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135790.127965:0:9959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9959:1876044666685056:0@lo:900: 00000100:00100000:1.0:1789135790.137814:0:9964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666685184:0@lo:5: 00000100:00100000:1.0:1789135790.137906:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135790.137958:0:9964:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135790.137981:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685184 00000100:00100000:1.0:1789135790.137987:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685184 00000100:00100000:1.0:1789135790.138038:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789135790.138048:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9964:x1876044666685184:12345-0@lo:5: 00002000:00080000:1.0:1789135790.148625:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789135790.148649:0:8432:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789135790.155417:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9964:x1876044666685184:12345-0@lo:5: Request processed in 17363us (17503us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789135790.155431:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789135790.156233:0:9964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6608f00 x1876044666685184/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789135806 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135790.156264:0:9964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9964:1876044666685184:0@lo:5: 00000004:00080000:3.0:1789135790.156292:0:9964:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:2.0:1789135790.247295:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1789135790.247392:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789135790.248143:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135790.952328:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135790.952358:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666685312:0@lo:41: 00000100:00100000:3.0:1789135790.952438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135790.952701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685312 00000100:00100000:2.0:1789135790.952710:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685312 00000100:00100000:2.0:1789135790.952794:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135790.952805:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666685312:12345-0@lo:41: 00000004:00000024:2.0:1789135790.952876:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135790.952937:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666685312:12345-0@lo:41: Request processed in 134us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135790.952944:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135790.953035:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666685312:0@lo:41: 00010000:00010000:1.0:1789135791.286961:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135792.300329:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789135792.348450:0:10034:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789135792.349131:0:10034:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789135793.321387:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789135793.357543:0:10082:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789135793.357556:0:10082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789135793.913105:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135793.913831:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644614272 00000100:00100000:3.0:1789135793.913843:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644614272 00000100:00100000:3.0:1789135793.913936:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:3.0:1789135793.913944:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1876044644614272:12345-192.168.201.31@tcp:250: 00010000:00080000:3.0:1789135793.913970:0:6508:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from f56ac69e-f262-403a-94d3-403db5052814@192.168.201.31@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789135793.914010:0:6508:0:(genops.c:1385:class_connect()) connect: client f56ac69e-f262-403a-94d3-403db5052814, cookie 0x559c8745c6de2983 00000100:00080000:3.0:1789135793.914166:0:6508:0:(import.c:65:import_set_state_nolock()) ffff90a7ff551000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135793.914257:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+5:2388:x1876044644614272:12345-192.168.201.31@tcp:250: Request processed in 311us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.914265:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:0.0:1789135793.930317:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135793.930429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644614400 00000100:00100000:1.0:1789135793.930440:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644614400 00000100:00100000:1.0:1789135793.930501:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:1.0:1789135793.930511:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+5:6153:x1876044644614400:12345-192.168.201.31@tcp:101: 00010000:00010000:1.0:1789135793.930529:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135793.930548:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab087bd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.930581:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.930591:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135793.930601:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878a00, rc 0) 00000100:00100000:1.0:1789135793.930679:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+6:6153:x1876044644614400:12345-192.168.201.31@tcp:101: Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.930687:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:1.0:1789135793.943792:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135793.943980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644614528 00000100:00100000:0.0:1789135793.943991:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644614528 00000100:00100000:0.0:1789135793.944073:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00100000:0.0:1789135793.944086:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+6:6153:x1876044644614528:12345-192.168.201.31@tcp:501: 00000100:00100000:0.0:1789135793.944334:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+6:6153:x1876044644614528:12345-192.168.201.31@tcp:501: Request processed in 249us (557us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135793.944342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00100000:2.0:1789135793.954825:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135793.955016:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644614656 00000100:00100000:3.0:1789135793.955026:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644614656 00000100:00100000:3.0:1789135793.955089:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 185 00000100:00100000:3.0:1789135793.955101:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+6:6153:x1876044644614656:12345-192.168.201.31@tcp:101: 00010000:00010000:3.0:1789135793.955119:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135793.955137:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab087c4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.955180:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.955208:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135793.955229:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a802045400, rc 0) 00000100:00100000:3.0:1789135793.955289:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+7:6153:x1876044644614656:12345-192.168.201.31@tcp:101: Request processed in 190us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.955296:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 185 00000100:00100000:3.0:1789135793.957991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135793.958563:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644614784 00000100:00100000:0.0:1789135793.958574:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644614784 00000100:00100000:0.0:1789135793.958637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 186 00000100:00100000:0.0:1789135793.958648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+7:6153:x1876044644614784:12345-192.168.201.31@tcp:501: 00000100:00100000:0.0:1789135793.958837:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+8:6153:x1876044644614784:12345-192.168.201.31@tcp:501: Request processed in 189us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135793.958845:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 186 00000100:00100000:0.0:1789135793.969890:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135793.970139:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644614912 00000100:00100000:1.0:1789135793.970151:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644614912 00000100:00100000:1.0:1789135793.970254:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 187 00000100:00100000:1.0:1789135793.970266:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+8:6153:x1876044644614912:12345-192.168.201.31@tcp:503: 00000100:00100000:1.0:1789135793.970633:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+8:6153:x1876044644614912:12345-192.168.201.31@tcp:503: Request processed in 368us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135793.970652:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 187 00000100:00100000:2.0:1789135793.981694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135793.981785:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615040 00000100:00100000:3.0:1789135793.981794:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615040 00000100:00100000:3.0:1789135793.981841:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 188 00000100:00100000:3.0:1789135793.981849:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+8:6172:x1876044644615040:12345-192.168.201.31@tcp:502: 00000100:00100000:3.0:1789135793.982013:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+8:6172:x1876044644615040:12345-192.168.201.31@tcp:502: Request processed in 163us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135793.982022:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 188 00000100:00100000:3.0:1789135794.031460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135794.031980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615168 00000100:00100000:0.0:1789135794.031992:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615168 00000100:00100000:0.0:1789135794.032065:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 189 00000100:00100000:0.0:1789135794.032077:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+8:6172:x1876044644615168:12345-192.168.201.31@tcp:502: 00000100:00100000:0.0:1789135794.035741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+8:6172:x1876044644615168:12345-192.168.201.31@tcp:502: Request processed in 3649us (4280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135794.035759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 189 00000100:00100000:0.0:1789135794.048325:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135794.048456:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615296 00000100:00100000:1.0:1789135794.048467:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615296 00000100:00100000:1.0:1789135794.048531:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 190 00000100:00100000:1.0:1789135794.048542:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+8:6153:x1876044644615296:12345-192.168.201.31@tcp:101: 00010000:00010000:1.0:1789135794.048560:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135794.048577:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879000/0x559c8745c6de2998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab087f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048607:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879000/0x559c8745c6de2998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087f5 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048620:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de2998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087f5 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135794.048629:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879000, rc 0) 00000100:00100000:1.0:1789135794.048689:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+9:6153:x1876044644615296:12345-192.168.201.31@tcp:101: Request processed in 150us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.048697:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 190 00000100:00100000:2.0:1789135794.063418:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135794.063580:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615424 00000100:00100000:0.0:1789135794.063592:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615424 00000100:00100000:0.0:1789135794.063653:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:0.0:1789135794.063663:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+9:6153:x1876044644615424:12345-192.168.201.31@tcp:256: 20000000:01000000:0.0:1789135794.063691:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789135794.063726:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789135794.063730:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789135794.063733:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789135794.063736:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789135794.063738:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789135794.065979:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+9:6153:x1876044644615424:12345-192.168.201.31@tcp:256: Request processed in 2306us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.066003:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:2.0:1789135794.072793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135794.073474:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615552 00000100:00100000:3.0:1789135794.073486:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615552 00000100:00100000:3.0:1789135794.073552:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:3.0:1789135794.073564:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+9:6153:x1876044644615552:12345-192.168.201.31@tcp:101: 00010000:00010000:3.0:1789135794.073583:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135794.073605:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab087fc expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.073659:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.073671:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135794.073682:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a802045c00, rc 0) 00000100:00100000:3.0:1789135794.073758:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:6153:x1876044644615552:12345-192.168.201.31@tcp:101: Request processed in 189us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.073766:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:2.0:1789135794.077996:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135794.078173:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615680 00000100:00100000:3.0:1789135794.078183:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615680 00000100:00100000:3.0:1789135794.078252:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:3.0:1789135794.078263:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6153:x1876044644615680:12345-192.168.201.31@tcp:501: 00000100:00100000:3.0:1789135794.078434:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6153:x1876044644615680:12345-192.168.201.31@tcp:501: Request processed in 164us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.078449:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:0.0:1789135794.085112:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135794.085294:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615808 00000100:00100000:1.0:1789135794.085308:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615808 00000100:00100000:1.0:1789135794.085375:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:1.0:1789135794.085386:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6153:x1876044644615808:12345-192.168.201.31@tcp:503: 00000100:00100000:1.0:1789135794.085575:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6153:x1876044644615808:12345-192.168.201.31@tcp:503: Request processed in 190us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.085584:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:2.0:1789135794.095798:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135794.097235:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644615936 00000100:00100000:1.0:1789135794.097267:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644615936 00000100:00100000:1.0:1789135794.097346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 195 00000100:00100000:1.0:1789135794.097359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:6179:x1876044644615936:12345-192.168.201.31@tcp:502: 00000100:00100000:1.0:1789135794.097562:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:6179:x1876044644615936:12345-192.168.201.31@tcp:502: Request processed in 203us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135794.097571:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 195 00000100:00100000:2.0:1789135794.104523:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135794.104623:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616064 00000100:00100000:3.0:1789135794.104633:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616064 00000100:00100000:3.0:1789135794.104697:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:3.0:1789135794.104708:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6179:x1876044644616064:12345-192.168.201.31@tcp:502: 00000100:00100000:3.0:1789135794.104931:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6179:x1876044644616064:12345-192.168.201.31@tcp:502: Request processed in 224us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.104939:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:0.0:1789135794.113058:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135794.113109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135794.113204:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616192 00000100:00100000:3.0:1789135794.113240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616192 00000100:00100000:3.0:1789135794.113294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616448 00000100:00100000:3.0:1789135794.113297:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616448 00000100:00100000:3.0:1789135794.113326:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789135794.113335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876044644616192:12345-192.168.201.31@tcp:38: 00010000:00080000:3.0:1789135794.113371:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789135794.113420:0:6517:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de29a6 00000004:00100000:3.0:1789135794.113465:0:6517:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789135794.113681:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90a6c2df3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135794.113754:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644616192:12345-192.168.201.31@tcp:38: Request processed in 418us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.113762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789135794.113783:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1789135794.113787:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876044644616448:12345-192.168.201.31@tcp:38: 00010000:00080000:3.0:1789135794.113800:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:3.0:1789135794.113828:0:6517:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de29ad 00000004:00100000:3.0:1789135794.113840:0:6517:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789135794.114027:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90a7ff592000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135794.114053:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644616448:12345-192.168.201.31@tcp:38: Request processed in 264us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.114061:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00010000:00010000:2.0:1789135794.344134:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135794.536313:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135794.536346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666685440:0@lo:41: 00000100:00100000:2.0:1789135794.536428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135794.536598:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685440 00000100:00100000:3.0:1789135794.536607:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685440 00000100:00100000:3.0:1789135794.536671:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789135794.536681:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666685440:12345-0@lo:41: 00000004:00000024:3.0:1789135794.536715:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789135794.536780:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666685440:12345-0@lo:41: Request processed in 100us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135794.536787:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789135794.537320:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666685440:0@lo:41: 00000100:00100000:3.0:1789135795.048315:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666685952:0@lo:400: 00000100:00100000:3.0:1789135795.048386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.048470:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666686464:0@lo:400: 00000100:00100000:3.0:1789135795.048497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.048517:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666686976:0@lo:400: 00000100:00100000:3.0:1789135795.048535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.048566:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789135795.048572:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666685824:0@lo:400: 00000100:00100000:3.0:1789135795.048594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.048610:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666686336:0@lo:400: 00000100:00100000:3.0:1789135795.048628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.048642:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666686848:0@lo:400: 00000100:00100000:3.0:1789135795.048664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.048692:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686464 00000100:00100000:3.0:1789135795.048699:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686464 00000100:00100000:3.0:1789135795.048754:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686976 00000100:00100000:3.0:1789135795.048757:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686976 00000100:00100000:3.0:1789135795.048775:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135795.048784:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666686464:12345-0@lo:400: 00000100:00100000:3.0:1789135795.048832:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666686464:12345-0@lo:400: Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.048840:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789135795.048890:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135795.048896:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666686976:12345-0@lo:400: 00000100:00100000:3.0:1789135795.048943:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666686976:12345-0@lo:400: Request processed in 47us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.048948:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789135795.048967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685824 00000100:00100000:3.0:1789135795.048970:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685824 00000100:00100000:3.0:1789135795.048996:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789135795.049002:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666685824:12345-0@lo:400: 00000100:00100000:3.0:1789135795.049033:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666685824:12345-0@lo:400: Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.049039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789135795.049057:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685952 00000100:00100000:3.0:1789135795.049060:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685952 00000100:00100000:3.0:1789135795.049081:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686336 00000100:00100000:3.0:1789135795.049083:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686336 00000100:00100000:3.0:1789135795.049093:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686848 00000100:00100000:3.0:1789135795.049094:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686848 00000100:00100000:3.0:1789135795.049107:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135795.049112:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666685952:12345-0@lo:400: 00000100:00100000:3.0:1789135795.049140:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666685952:12345-0@lo:400: Request processed in 27us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.049145:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135795.049154:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135795.049159:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666686336:12345-0@lo:400: 00000100:00100000:3.0:1789135795.049182:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666686336:12345-0@lo:400: Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.049187:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135795.049207:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135795.049213:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666686848:12345-0@lo:400: 00000100:00100000:3.0:1789135795.049245:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666686848:12345-0@lo:400: Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.049250:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135795.049303:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666685824:0@lo:400: 00010000:00080000:3.0:1789135795.049315:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8d680 x1876044666686336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135795.049324:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666686336:0@lo:400: 00010000:00080000:3.0:1789135795.049331:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671e580 x1876044666686848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135795.049339:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666686848:0@lo:400: 00010000:00080000:3.0:1789135795.049347:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8da40 x1876044666685952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135795.049355:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666685952:0@lo:400: 00010000:00080000:3.0:1789135795.049363:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8fc00 x1876044666686464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135795.049369:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666686464:0@lo:400: 00010000:00080000:3.0:1789135795.049376:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671d2c0 x1876044666686976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135795.049382:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789135795.049396:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666686976:0@lo:400: 00000100:00100000:2.0:1789135795.049510:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666685568:0@lo:400: 00000100:00100000:2.0:1789135795.049547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049581:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666686080:0@lo:400: 00000100:00100000:2.0:1789135795.049604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049621:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666686592:0@lo:400: 00000100:00100000:2.0:1789135795.049639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049653:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687104:0@lo:400: 00000100:00100000:2.0:1789135795.049673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049695:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789135795.049701:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666685696:0@lo:400: 00000100:00100000:2.0:1789135795.049721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049736:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666686208:0@lo:400: 00000100:00100000:2.0:1789135795.049753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049765:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666686720:0@lo:400: 00000100:00100000:2.0:1789135795.049784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.049806:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686592 00000100:00100000:2.0:1789135795.049810:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686592 00000100:00100000:2.0:1789135795.049833:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687104 00000100:00100000:2.0:1789135795.049835:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687104 00000100:00100000:2.0:1789135795.049849:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135795.049878:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666686592:12345-0@lo:400: 00000100:00100000:2.0:1789135795.049911:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666686592:12345-0@lo:400: Request processed in 56us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.049917:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789135795.049929:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135795.049934:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687104:12345-0@lo:400: 00000100:00100000:2.0:1789135795.049956:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687104:12345-0@lo:400: Request processed in 22us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.049961:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789135795.049986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686080 00000100:00100000:2.0:1789135795.049988:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686080 00000100:00100000:2.0:1789135795.050013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135795.050018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666686080:12345-0@lo:400: 00000100:00100000:2.0:1789135795.050048:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666686080:12345-0@lo:400: Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.050063:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135795.050082:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685696 00000100:00100000:2.0:1789135795.050085:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685696 00000100:00100000:2.0:1789135795.050098:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686208 00000100:00100000:2.0:1789135795.050101:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686208 00000100:00100000:2.0:1789135795.050111:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666686720 00000100:00100000:2.0:1789135795.050113:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666686720 00000100:00100000:2.0:1789135795.050124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135795.050129:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666685696:12345-0@lo:400: 00000100:00100000:2.0:1789135795.050159:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666685696:12345-0@lo:400: Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.050165:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135795.050175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135795.050181:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666686208:12345-0@lo:400: 00000100:00100000:2.0:1789135795.050217:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666686208:12345-0@lo:400: Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.050222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135795.050232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789135795.050237:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666686720:12345-0@lo:400: 00000100:00100000:2.0:1789135795.050257:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666686720:12345-0@lo:400: Request processed in 21us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.050262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789135795.050295:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8f480 x1876044666685696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135795.050305:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666685696:0@lo:400: 00010000:00080000:2.0:1789135795.050313:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e940 x1876044666686208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135795.050327:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666686208:0@lo:400: 00010000:00080000:2.0:1789135795.050337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671f840 x1876044666686720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135795.050344:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666686720:0@lo:400: 00000100:00100000:2.0:1789135795.050352:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666686080:0@lo:400: 00010000:00080000:2.0:1789135795.050359:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671f480 x1876044666686592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135795.050366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666686592:0@lo:400: 00010000:00080000:2.0:1789135795.050373:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671c000 x1876044666687104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135795.050380:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789135795.050391:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687104:0@lo:400: 00000100:00080000:0.0:1789135795.050815:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135795.050820:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135795.050823:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135795.050826:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135795.051677:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135795.051693:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687232:0@lo:13: 00000100:00100000:0.0:1789135795.051741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135795.051779:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687232 00000100:00100000:0.0:1789135795.051785:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687232 00000100:00100000:0.0:1789135795.051821:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789135795.051829:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687232:12345-0@lo:13: 00002000:00000024:0.0:1789135795.051872:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135795.051910:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687232:12345-0@lo:13: Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.051917:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789135795.052056:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ceb0c0 x1876044666687232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135795.052072:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687232:0@lo:13: 00000100:00100000:1.0:1789135795.052265:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666687360:0@lo:13: 00000100:00100000:1.0:1789135795.052294:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135795.052363:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687360 00000100:00100000:2.0:1789135795.052367:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687360 00000100:00100000:2.0:1789135795.052398:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789135795.052404:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666687360:12345-0@lo:13: 00002000:00000024:2.0:1789135795.052414:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135795.052555:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666687360:12345-0@lo:13: Request processed in 151us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.052562:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789135795.052618:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6629e00 x1876044666687360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135795.052631:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666687360:0@lo:13: 00000100:00100000:3.0:1789135795.053075:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666685568 00000100:00100000:3.0:1789135795.053080:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666685568 00000100:00100000:3.0:1789135795.053153:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789135795.053169:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666685568:12345-0@lo:400: 00000100:00100000:3.0:1789135795.053224:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666685568:12345-0@lo:400: Request processed in 57us (3677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.053230:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789135795.053292:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666685568:0@lo:400: 00000100:00100000:2.0:1789135795.124692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135795.124745:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135795.124788:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135795.124949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616704 00000100:00100000:0.0:1789135795.124960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616704 00000100:00100000:0.0:1789135795.125029:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616320 00000100:00100000:0.0:1789135795.125033:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616320 00000100:00100000:0.0:1789135795.125044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616576 00000100:00100000:0.0:1789135795.125046:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616576 00000100:00100000:0.0:1789135795.125076:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789135795.125085:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:6153:x1876044644616704:12345-192.168.201.31@tcp:41: 00000004:00000024:0.0:1789135795.125126:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789135795.125200:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:6153:x1876044644616704:12345-192.168.201.31@tcp:41: Request processed in 106us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.125208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789135795.125225:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789135795.125233:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644616320:12345-192.168.201.31@tcp:41: 00000004:00000024:0.0:1789135795.125243:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789135795.125266:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644616320:12345-192.168.201.31@tcp:41: Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.125272:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789135795.125283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789135795.125289:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644616576:12345-192.168.201.31@tcp:41: 00000004:00000024:0.0:1789135795.125304:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789135795.125327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644616576:12345-192.168.201.31@tcp:41: Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.125333:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00080000:2.0:1789135795.125830:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135795.125836:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135795.127896:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135795.128031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616832 00000100:00100000:0.0:1789135795.128045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616832 00000100:00100000:0.0:1789135795.128102:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:0.0:1789135795.128111:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6153:x1876044644616832:12345-192.168.201.31@tcp:40: 00000100:00100000:0.0:1789135795.128205:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6153:x1876044644616832:12345-192.168.201.31@tcp:40: Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.128213:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:0.0:1789135795.140096:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135795.140137:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135795.140170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135795.140231:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135795.140269:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644616960 00000100:00100000:0.0:1789135795.140279:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644616960 00000100:00100000:0.0:1789135795.140314:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617088 00000100:00100000:0.0:1789135795.140317:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617088 00000100:00100000:0.0:1789135795.140336:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789135795.140344:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876044644616960:12345-192.168.201.31@tcp:8: 00010000:00080000:0.0:1789135795.140377:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1789135795.140408:0:8430:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de29b4 00002000:00100000:0.0:1789135795.140421:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 50163b70-8f7a-42d3-bcbf-652648370aa8/ffff90a6c3a29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789135795.140442:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789135795.140635:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789135795.140667:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a28800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135795.140734:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644616960:12345-192.168.201.31@tcp:8: Request processed in 388us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.140742:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789135795.140760:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1789135795.140765:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876044644617088:12345-192.168.201.31@tcp:8: 00010000:00080000:0.0:1789135795.140782:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1789135795.140798:0:8430:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de29bb 00002000:00100000:0.0:1789135795.140803:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 50163b70-8f7a-42d3-bcbf-652648370aa8/ffff90a6c3a2d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789135795.140817:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789135795.140984:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789135795.141001:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a28000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135795.141027:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644617088:12345-192.168.201.31@tcp:8: Request processed in 260us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135795.141033:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1789135795.141371:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617344 00000100:00100000:1.0:1789135795.141378:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617344 00000100:00100000:1.0:1789135795.141419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:1.0:1789135795.141435:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644617344:12345-192.168.201.31@tcp:400: 00000100:00100000:1.0:1789135795.141474:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644617344:12345-192.168.201.31@tcp:400: Request processed in 41us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.141481:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:3.0:1789135795.142056:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617216 00000100:00100000:3.0:1789135795.142062:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617216 00000100:00100000:3.0:1789135795.142154:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:3.0:1789135795.142164:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6153:x1876044644617216:12345-192.168.201.31@tcp:900: 00000100:00100000:3.0:1789135795.142233:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6153:x1876044644617216:12345-192.168.201.31@tcp:900: Request processed in 70us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.142240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:0.0:1789135795.148881:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135795.149049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617472 00000100:00100000:1.0:1789135795.149061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617472 00000100:00100000:1.0:1789135795.149121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1789135795.149145:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6153:x1876044644617472:12345-192.168.201.31@tcp:33: 00000004:00080000:1.0:1789135795.177634:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28389us 00000004:00200000:2.0:1789135795.204724:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789135795.204846:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6153:x1876044644617472:12345-192.168.201.31@tcp:33: Request processed in 55698us (56000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.204880:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00010000:00010000:1.0:1789135795.368719:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135795.441333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135795.441443:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617600 00000100:00100000:2.0:1789135795.441453:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617600 00000100:00100000:2.0:1789135795.441525:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789135795.441534:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6198:x1876044644617600:12345-192.168.201.31@tcp:101: 00010000:00010000:2.0:1789135795.441554:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135795.441612:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de29c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0882d expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.441672:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de29c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.441685:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de29c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.441699:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de29c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135795.441754:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789135795.441758:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135795.441773:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de29c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.441799:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de29c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0882d expref: 8 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.441837:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de29c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0882d expref: 7 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135795.441846:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3b00) 00010000:00010000:2.0:1789135795.441849:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135795.441894:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f600, rc 0) 00000100:00100000:2.0:1789135795.441954:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:6198:x1876044644617600:12345-192.168.201.31@tcp:101: Request processed in 421us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135795.441961:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:0.0:1789135795.562547:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135795.562577:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666687488:0@lo:13: 00000100:00100000:0.0:1789135795.562660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135795.562795:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687488 00000100:00100000:1.0:1789135795.562804:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687488 00000100:00100000:1.0:1789135795.562885:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789135795.562902:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666687488:12345-0@lo:13: 00002000:00000024:1.0:1789135795.562925:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135795.562927:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687616:0@lo:13: 00000100:00100000:2.0:1789135795.568256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135795.569137:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789135795.569152:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789135795.570288:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687616 00000100:00100000:2.0:1789135795.570299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687616 00000100:00100000:3.0:1789135795.570487:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789135795.570500:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687616:12345-0@lo:13: 00002000:00000024:3.0:1789135795.570528:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135795.570622:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687616:12345-0@lo:13: Request processed in 126us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135795.570629:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789135795.571102:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671d2c0 x1876044666687616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135795.571126:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687616:0@lo:13: 00000100:00100000:1.0:1789135795.571531:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666687488:12345-0@lo:13: Request processed in 8635us (8870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135795.571540:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789135795.573161:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6628780 x1876044666687488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135795.573196:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666687488:0@lo:13: 00000100:00100000:1.0:1789135796.072420:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135796.072458:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687744:0@lo:41: 00000100:00100000:1.0:1789135796.072578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135796.072744:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687744 00000100:00100000:3.0:1789135796.072755:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687744 00000100:00100000:3.0:1789135796.072812:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789135796.072824:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687744:12345-0@lo:41: 00000004:00000024:3.0:1789135796.072888:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135796.072959:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666687744:12345-0@lo:41: Request processed in 138us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135796.072967:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789135796.073224:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666687744:0@lo:41: 00010000:00010000:2.0:1789135796.392775:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135797.417565:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135797.781447:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135797.786569:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617728 00000100:00100000:0.0:1789135797.786586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617728 00000100:00100000:0.0:1789135797.788329:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:0.0:1789135797.788360:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:6250:x1876044644617728:12345-192.168.201.31@tcp:41: 00000004:00000024:0.0:1789135797.788408:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789135797.788496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:6250:x1876044644617728:12345-192.168.201.31@tcp:41: Request processed in 152us (7059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135797.788505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00080000:2.0:1789135797.788779:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135797.796098:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135797.796295:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617856 00000100:00100000:2.0:1789135797.796305:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617856 00000100:00100000:2.0:1789135797.796385:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1789135797.796398:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6250:x1876044644617856:12345-192.168.201.31@tcp:41: 00000004:00000024:2.0:1789135797.796437:0:8299:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135797.796508:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6250:x1876044644617856:12345-192.168.201.31@tcp:41: Request processed in 114us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135797.796522:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00080000:0.0:1789135797.796910:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135797.802428:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135797.802556:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644617984 00000100:00100000:2.0:1789135797.802572:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644617984 00000100:00100000:2.0:1789135797.802666:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:2.0:1789135797.802679:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6250:x1876044644617984:12345-192.168.201.31@tcp:13: 00002000:00000024:2.0:1789135797.802713:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135797.802815:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6250:x1876044644617984:12345-192.168.201.31@tcp:13: Request processed in 140us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135797.802822:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00080000:0.0:1789135797.803260:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135797.808271:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135797.808716:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618112 00000100:00100000:1.0:1789135797.808730:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618112 00000100:00100000:1.0:1789135797.808962:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:1.0:1789135797.808976:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6250:x1876044644618112:12345-192.168.201.31@tcp:13: 00002000:00000024:1.0:1789135797.809023:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135797.809123:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:50163b70-8f7a-42d3-bcbf-652648370aa8+6:6250:x1876044644618112:12345-192.168.201.31@tcp:13: Request processed in 150us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135797.809132:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00080000:0.0:1789135797.809262:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789135798.441849:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789135798.642110:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00010000:00010000:2.0:1789135799.466838:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135799.656084:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666687872:0@lo:41: 00000100:00100000:2.0:1789135799.656172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135799.656289:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666687872 00000100:00100000:0.0:1789135799.656298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666687872 00000100:00100000:0.0:1789135799.656363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135799.656385:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666687872:12345-0@lo:41: 00000004:00000024:0.0:1789135799.656421:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789135799.656465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666687872:12345-0@lo:41: Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135799.656472:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789135799.656606:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666687872:0@lo:41: 00000001:00100000:2.0:1789135799.675337:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000001:00100000:1.0:1789135799.675989:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000100:00100000:1.0:1789135800.168090:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666688128:0@lo:400: 00000100:00100000:0.0:1789135800.168170:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666688256:0@lo:400: 00000100:00100000:1.0:1789135800.168173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135800.168203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135800.168226:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666688768:0@lo:400: 00000100:00100000:1.0:1789135800.168234:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666688640:0@lo:400: 00000100:00100000:0.0:1789135800.168246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135800.168257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135800.168261:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666689280:0@lo:400: 00000100:00100000:1.0:1789135800.168270:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666689152:0@lo:400: 00000100:00100000:0.0:1789135800.168279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135800.168290:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135800.168305:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666689664:0@lo:400: 00000100:00100000:0.0:1789135800.168309:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688256 00000100:00100000:0.0:1789135800.168315:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688256 00000100:00100000:1.0:1789135800.168324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135800.168349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688768 00000100:00100000:1.0:1789135800.168353:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688768 00000100:00100000:0.0:1789135800.168368:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689280 00000100:00100000:0.0:1789135800.168371:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689280 00000100:00100000:1.0:1789135800.168383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135800.168537:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666688384:0@lo:400: 00000100:00100000:3.0:1789135800.168546:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666688000:0@lo:13: 00000100:00100000:2.0:1789135800.168569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.168571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.168588:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666688512:0@lo:400: 00000100:00100000:2.0:1789135800.168588:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666688896:0@lo:400: 00000100:00100000:2.0:1789135800.168606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.168613:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688128 00000100:00100000:3.0:1789135800.168616:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688128 00000100:00100000:2.0:1789135800.168620:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666689408:0@lo:400: 00000100:00100000:2.0:1789135800.168640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.168644:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789135800.168650:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666688128:12345-0@lo:400: 00000100:00100000:2.0:1789135800.168662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688640 00000100:00100000:2.0:1789135800.168666:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688640 00000100:00100000:2.0:1789135800.168691:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688384 00000100:00100000:3.0:1789135800.168693:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666688128:12345-0@lo:400: Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.168693:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688384 00000100:00100000:3.0:1789135800.168700:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789135800.168715:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789135800.168730:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688000 00000100:00100000:3.0:1789135800.168749:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688000 00000100:00100000:3.0:1789135800.168779:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789135800.168786:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666688000:12345-0@lo:13: 00002000:00000024:3.0:1789135800.168811:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135800.168843:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666688000:12345-0@lo:13: Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.168849:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789135800.168883:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666688256:12345-0@lo:400: 00000100:00100000:3.0:1789135800.168897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.168910:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666689024:0@lo:400: 00000100:00100000:1.0:1789135800.168916:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666688256:12345-0@lo:400: Request processed in 527us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.168930:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.168947:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666689536:0@lo:400: 00000100:00100000:3.0:1789135800.168969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789135800.169006:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ed2c0 x1876044666688000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135800.169052:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666688000:0@lo:13: 00000100:00100000:3.0:1789135800.169079:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689152 00000100:00100000:3.0:1789135800.169083:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689152 00000100:00100000:3.0:1789135800.169111:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689664 00000100:00100000:3.0:1789135800.169115:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689664 00000100:00100000:3.0:1789135800.169128:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689024 00000100:00100000:3.0:1789135800.169130:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689024 00000100:00100000:3.0:1789135800.169141:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689536 00000100:00100000:3.0:1789135800.169143:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689536 00000100:00100000:3.0:1789135800.169155:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135800.169160:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666689152:12345-0@lo:400: 00000100:00100000:3.0:1789135800.169192:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666689152:12345-0@lo:400: Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.169198:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789135800.169210:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135800.169217:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666689664:12345-0@lo:400: 00000100:00100000:3.0:1789135800.169259:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666689664:12345-0@lo:400: Request processed in 43us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.169266:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789135800.169277:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789135800.169283:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666689024:12345-0@lo:400: 00000100:00100000:2.0:1789135800.169290:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666688640:12345-0@lo:400: 00000100:00100000:3.0:1789135800.169313:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666689024:12345-0@lo:400: Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.169319:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789135800.169321:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666688640:12345-0@lo:400: Request processed in 601us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.169327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789135800.169330:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135800.169340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135800.169346:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666688384:12345-0@lo:400: 00000100:00100000:3.0:1789135800.169349:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666689536:12345-0@lo:400: 00000100:00100000:2.0:1789135800.169377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666688384:12345-0@lo:400: Request processed in 31us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.169380:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666689536:12345-0@lo:400: Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.169383:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789135800.169385:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789135800.169399:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688896 00000100:00100000:2.0:1789135800.169403:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688896 00010000:00080000:3.0:1789135800.169407:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a70c0 x1876044666689024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135800.169417:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666689024:0@lo:400: 00010000:00080000:3.0:1789135800.169425:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a61c0 x1876044666689536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135800.169433:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666689536:0@lo:400: 00000100:00100000:3.0:1789135800.169485:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666689792:0@lo:13: 00000100:00100000:3.0:1789135800.169513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.169538:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666688256:0@lo:400: 00000100:00100000:3.0:1789135800.169561:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689792 00000100:00100000:3.0:1789135800.169563:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689792 00000100:00100000:3.0:1789135800.169584:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789135800.169590:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666689792:12345-0@lo:13: 00002000:00000024:3.0:1789135800.169600:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135800.169628:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666689792:12345-0@lo:13: Request processed in 38us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.169634:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789135800.169657:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662b840 x1876044666689792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135800.169668:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666689792:0@lo:13: 00000100:00100000:3.0:1789135800.169703:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666688384:0@lo:400: 00000100:00080000:3.0:1789135800.169736:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135800.169740:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135800.169742:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135800.169744:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135800.169755:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689408 00000100:00100000:3.0:1789135800.169758:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689408 00000100:00100000:0.0:1789135800.170474:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666688512 00000100:00100000:0.0:1789135800.170480:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666688512 00000100:00100000:0.0:1789135800.170505:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135800.170511:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666688768:12345-0@lo:400: 00000100:00100000:0.0:1789135800.170571:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666688768:12345-0@lo:400: Request processed in 60us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135800.170578:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135800.170594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135800.170601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666689280:12345-0@lo:400: 00000100:00100000:0.0:1789135800.170629:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666689280:12345-0@lo:400: Request processed in 29us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135800.170635:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135800.170660:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135800.170666:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666688512:12345-0@lo:400: 00000100:00100000:0.0:1789135800.170700:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666688512:12345-0@lo:400: Request processed in 35us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135800.170705:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135800.170764:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666688768:0@lo:400: 00000100:00100000:0.0:1789135800.170776:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666689280:0@lo:400: 00000100:00100000:0.0:1789135800.170809:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666688512:0@lo:400: 00000100:00100000:0.0:1789135800.170844:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666688640:0@lo:400: 00010000:00080000:0.0:1789135800.170873:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a5a40 x1876044666689152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135800.170890:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666689152:0@lo:400: 00010000:00080000:0.0:1789135800.170904:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a43c0 x1876044666689664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135800.170913:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666689664:0@lo:400: 00000100:00100000:0.0:1789135800.170924:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666688128:0@lo:400: 00000100:00080000:0.0:1789135800.170956:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135800.175748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135800.176285:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135800.176308:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666688896:12345-0@lo:400: 00000100:00100000:2.0:1789135800.176424:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666688896:12345-0@lo:400: Request processed in 129us (7816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.176432:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789135800.176448:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789135800.176455:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666689408:12345-0@lo:400: 00000100:00100000:2.0:1789135800.176485:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666689408:12345-0@lo:400: Request processed in 31us (7844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.176491:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789135800.176588:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a4f00 x1876044666688896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135800.176603:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666688896:0@lo:400: 00010000:00080000:1.0:1789135800.176620:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a7c00 x1876044666689408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135800.176629:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666689408:0@lo:400: 00000100:00100000:1.0:1789135800.305304:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135800.305350:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135800.305384:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135800.305426:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618496 00000100:00100000:1.0:1789135800.305434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135800.305437:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618496 00000100:00100000:1.0:1789135800.305457:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135800.305493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618368 00000100:00100000:1.0:1789135800.305493:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618752 00000100:00100000:3.0:1789135800.305497:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618368 00000100:00100000:1.0:1789135800.305497:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618752 00000100:00100000:3.0:1789135800.305518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1789135800.305523:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618624 00000100:00100000:1.0:1789135800.305526:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618624 00000100:00100000:3.0:1789135800.305528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644618496:12345-192.168.201.31@tcp:400: 00000100:00100000:1.0:1789135800.305546:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789135800.305551:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644618752:12345-192.168.201.31@tcp:400: 00000100:00100000:2.0:1789135800.305626:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:2.0:1789135800.305636:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644618368:12345-192.168.201.31@tcp:400: 00000100:00100000:1.0:1789135800.305695:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644618752:12345-192.168.201.31@tcp:400: Request processed in 143us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135800.305703:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789135800.305734:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1789135800.305741:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644618624:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1789135800.305797:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618240 00000100:00100000:0.0:1789135800.305802:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618240 00000100:00100000:0.0:1789135800.305832:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 200 00000100:00100000:0.0:1789135800.305838:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644618240:12345-192.168.201.31@tcp:400: 00000100:00100000:3.0:1789135800.312219:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644618496:12345-192.168.201.31@tcp:400: Request processed in 6676us (6852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.312236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:2.0:1789135800.312274:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644618368:12345-192.168.201.31@tcp:400: Request processed in 6638us (6836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135800.312302:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00080000:2.0:1789135800.312378:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135800.312385:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135800.312388:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135800.312391:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135800.323494:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644618624:12345-192.168.201.31@tcp:400: Request processed in 17741us (18022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135800.323511:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1789135800.324353:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644618240:12345-192.168.201.31@tcp:400: Request processed in 18510us (19056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135800.324382:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 200 00010000:00010000:1.0:1789135800.489066:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135800.683850:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135800.684046:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666689920:0@lo:13: 00000100:00100000:3.0:1789135800.684128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.684199:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666689920 00000100:00100000:3.0:1789135800.684206:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666689920 00000100:00100000:3.0:1789135800.684247:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789135800.684255:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666689920:12345-0@lo:13: 00002000:00000024:3.0:1789135800.684282:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135800.685432:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666689920:12345-0@lo:13: Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.685447:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789135800.685520:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671d2c0 x1876044666689920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135800.685553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666689920:0@lo:13: 00000001:00100000:1.0:1789135800.686296:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000100:00100000:1.0:1789135800.687123:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135800.687142:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666690048:0@lo:13: 00000100:00100000:1.0:1789135800.687202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135800.687288:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690048 00000100:00100000:3.0:1789135800.687296:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690048 00000100:00100000:3.0:1789135800.687407:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135800.687418:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666690048:12345-0@lo:13: 00002000:00000024:3.0:1789135800.687439:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135800.687483:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66eda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666690048:12345-0@lo:13: Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135800.687490:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789135800.687519:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671d2c0 x1876044666690048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135800.687535:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666690048:0@lo:13: 00000001:02000400:3.0:1789135801.157522:0:10181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789135801.192126:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135801.192157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666690176:0@lo:41: 00000100:00100000:1.0:1789135801.192235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135801.192496:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690176 00000100:00100000:1.0:1789135801.192505:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690176 00000100:00100000:1.0:1789135801.192559:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135801.192582:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666690176:12345-0@lo:41: 00000004:00000024:1.0:1789135801.192620:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135801.192671:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666690176:12345-0@lo:41: Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135801.192678:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789135801.192732:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666690176:0@lo:41: 00010000:00010000:2.0:1789135801.512348:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135802.538918:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135803.563542:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135804.583984:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135804.778999:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135804.779034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666690304:0@lo:41: 00000100:00100000:0.0:1789135804.779153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135804.779297:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690304 00000100:00100000:3.0:1789135804.779306:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690304 00000100:00100000:3.0:1789135804.779366:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789135804.779376:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666690304:12345-0@lo:41: 00000004:00000024:3.0:1789135804.779412:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789135804.779463:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666690304:12345-0@lo:41: Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135804.779470:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789135804.779513:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666690304:0@lo:41: 00000100:00100000:0.0:1789135805.288083:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666690432:0@lo:13: 00000100:00100000:0.0:1789135805.288171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.293549:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135805.293572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666690560:0@lo:13: 00000100:00100000:0.0:1789135805.293657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.293718:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690432 00000100:00100000:0.0:1789135805.293725:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690432 00000100:00100000:0.0:1789135805.293793:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690560 00000100:00100000:0.0:1789135805.293797:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690560 00000100:00100000:0.0:1789135805.293816:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135805.293824:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666690432:12345-0@lo:13: 00002000:00000024:0.0:1789135805.293878:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135805.293926:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666690432:12345-0@lo:13: Request processed in 103us (5755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.293933:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135805.293949:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135805.293955:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666690560:12345-0@lo:13: 00002000:00000024:0.0:1789135805.293966:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135805.293989:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666690560:12345-0@lo:13: Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.293995:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789135805.294171:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135805.294200:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ee1c0 x1876044666690560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.294220:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666690560:0@lo:13: 00010000:00080000:0.0:1789135805.294235:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671f480 x1876044666690432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.294247:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666690432:0@lo:13: 00000100:00100000:0.0:1789135805.294512:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666690688:0@lo:400: 00000100:00100000:0.0:1789135805.294550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.294586:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666691200:0@lo:400: 00000100:00100000:0.0:1789135805.294620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.294642:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666691712:0@lo:400: 00000100:00100000:0.0:1789135805.294665:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.294710:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789135805.294717:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666690816:0@lo:400: 00000100:00100000:0.0:1789135805.294741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.294759:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666691328:0@lo:400: 00000100:00100000:0.0:1789135805.294910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.294930:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666691840:0@lo:400: 00000100:00100000:0.0:1789135805.294954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.294982:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691200 00000100:00100000:0.0:1789135805.294986:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691200 00000100:00100000:0.0:1789135805.295030:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789135805.295038:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666691200:12345-0@lo:400: 00000100:00100000:0.0:1789135805.295081:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666691200:12345-0@lo:400: Request processed in 44us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.295095:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789135805.295117:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691712 00000100:00100000:0.0:1789135805.295121:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691712 00000100:00100000:0.0:1789135805.295152:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690816 00000100:00100000:0.0:1789135805.295155:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690816 00000100:00100000:0.0:1789135805.295166:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691328 00000100:00100000:0.0:1789135805.295168:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691328 00000100:00100000:0.0:1789135805.295181:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135805.295186:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666691712:12345-0@lo:400: 00000100:00100000:0.0:1789135805.295220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666691712:12345-0@lo:400: Request processed in 34us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.295226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135805.295238:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789135805.295244:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666690816:12345-0@lo:400: 00000100:00100000:0.0:1789135805.295270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666690816:12345-0@lo:400: Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.295276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789135805.295287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789135805.295293:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666691328:12345-0@lo:400: 00000100:00100000:0.0:1789135805.295319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666691328:12345-0@lo:400: Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.295324:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789135805.295349:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691840 00000100:00100000:0.0:1789135805.295353:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691840 00000100:00100000:0.0:1789135805.295379:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789135805.295386:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666691840:12345-0@lo:400: 00000100:00100000:0.0:1789135805.295415:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666691840:12345-0@lo:400: Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.295428:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789135805.295454:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135805.295457:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135805.295459:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135805.295482:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666690816:0@lo:400: 00000100:00100000:0.0:1789135805.295491:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6628780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666691328:0@lo:400: 00010000:00080000:0.0:1789135805.295502:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e81e00 x1876044666691840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.295510:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666691840:0@lo:400: 00000100:00100000:0.0:1789135805.295518:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666691200:0@lo:400: 00010000:00080000:0.0:1789135805.295527:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82d00 x1876044666691712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.295534:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666691712:0@lo:400: 00000100:00100000:0.0:1789135805.295566:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666690944:0@lo:400: 00000100:00100000:0.0:1789135805.295593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.295683:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666691456:0@lo:400: 00000100:00100000:0.0:1789135805.295709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.295728:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666691968:0@lo:400: 00000100:00100000:0.0:1789135805.295747:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.295843:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135805.295876:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666691072:0@lo:400: 00000100:00100000:0.0:1789135805.295902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.295919:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666691584:0@lo:400: 00000100:00100000:0.0:1789135805.295949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.295975:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690944 00000100:00100000:0.0:1789135805.295978:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690944 00000100:00100000:0.0:1789135805.296017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135805.296023:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666690944:12345-0@lo:400: 00000100:00100000:0.0:1789135805.296062:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666690944:12345-0@lo:400: Request processed in 39us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.296067:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789135805.296083:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691968 00000100:00100000:0.0:1789135805.296086:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691968 00000100:00100000:0.0:1789135805.296113:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135805.296119:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666691968:12345-0@lo:400: 00000100:00100000:0.0:1789135805.296146:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666691968:12345-0@lo:400: Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.296152:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789135805.296170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691456 00000100:00100000:0.0:1789135805.296174:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691456 00000100:00100000:0.0:1789135805.296193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691072 00000100:00100000:0.0:1789135805.296196:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691072 00000100:00100000:0.0:1789135805.296206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666691584 00000100:00100000:0.0:1789135805.296208:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666691584 00000100:00100000:0.0:1789135805.296219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789135805.296225:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666691456:12345-0@lo:400: 00000100:00100000:0.0:1789135805.296253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666691456:12345-0@lo:400: Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.296258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789135805.296270:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135805.296276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666691072:12345-0@lo:400: 00000100:00100000:0.0:1789135805.296309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666691072:12345-0@lo:400: Request processed in 33us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.296315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135805.296327:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789135805.296333:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666691584:12345-0@lo:400: 00000100:00100000:0.0:1789135805.296357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666691584:12345-0@lo:400: Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.296363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789135805.296381:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135805.296384:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135805.296386:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135805.296409:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666691072:0@lo:400: 00000100:00100000:0.0:1789135805.296419:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666691584:0@lo:400: 00000100:00100000:0.0:1789135805.296428:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666690944:0@lo:400: 00010000:00080000:0.0:1789135805.296437:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6629e00 x1876044666691456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.296446:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666691456:0@lo:400: 00010000:00080000:0.0:1789135805.296454:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82940 x1876044666691968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.296461:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666691968:0@lo:400: 00000100:00100000:2.0:1789135805.296571:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666690688 00000100:00100000:2.0:1789135805.296576:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666690688 00000100:00100000:2.0:1789135805.296608:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789135805.296627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666690688:12345-0@lo:400: 00000100:00100000:2.0:1789135805.296667:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666690688:12345-0@lo:400: Request processed in 53us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.296673:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789135805.298004:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6629680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666690688:0@lo:400: 00000020:00000080:3.0:1789135805.303034:0:10329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0fa28650 20000000:00000080:3.0:1789135805.303056:0:10329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7f6620c00 uarg=0000000000000000 20000000:01000000:3.0:1789135805.303117:0:10329:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789135805.303124:0:10329:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789135805.303126:0:10329:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789135805.303132:0:10329:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789135805.303138:0:10329:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789135805.303196:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789135805.303199:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789135805.303701:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789135805.304412:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789135805.304444:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789135805.304461:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1789135805.304472:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789135805.304474:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789135805.304951:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789135805.305148:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789135805.305172:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789135805.305189:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1789135805.305205:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789135805.305207:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789135805.305732:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:3.0:1789135805.306482:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:3.0:1789135805.306507:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:3.0:1789135805.306527:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:3.0:1789135805.306537:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789135805.306540:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789135805.307251:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1789135805.307436:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1789135805.307460:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1789135805.307475:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:3.0:1789135805.307485:0:10329:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789135805.307487:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789135805.307983:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1789135805.308144:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1789135805.308183:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1789135805.308200:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:3.0:1789135805.308214:0:10329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789135805.308235:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308253:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2864 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308260:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de288e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308274:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28cd expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308280:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28db expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308286:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308292:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2905 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308297:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de292f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308303:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de294b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308309:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2975 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308317:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308324:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308330:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308377:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308393:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 9 pid: 6508 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.308407:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692096:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135805.308513:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308522:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 9 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.308531:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692224:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135805.308564:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2975 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308572:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2975 expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.308582:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692352:0@lo:104: 00000100:00100000:3.0:1789135805.308701:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135805.308790:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de294b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.308799:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de294b expref: 23 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.308818:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692480:0@lo:104: 00000100:00100000:3.0:1789135805.308842:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135805.309909:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de292f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.309923:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de292f expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.309935:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692608:0@lo:104: 00000100:00100000:1.0:1789135805.309942:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666692352 00000100:00100000:1.0:1789135805.309951:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666692352 00000100:00100000:3.0:1789135805.309973:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135805.309993:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2905 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.310001:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2905 expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.310020:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692736:0@lo:104: 00000100:00100000:3.0:1789135805.310044:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135805.310064:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.310074:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.310079:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789135805.310083:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692864:0@lo:104: 00000100:00100000:0.0:1789135805.310104:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666692480 00000100:00100000:0.0:1789135805.310109:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666692480 00000100:00100000:3.0:1789135805.310112:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.310131:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666692608 00010000:00010000:3.0:1789135805.310136:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de28db expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.310136:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666692608 00000100:00100000:0.0:1789135805.310150:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666692736 00000100:00100000:0.0:1789135805.310154:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666692736 00010000:00010000:3.0:1789135805.310161:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de28db expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.310166:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666692864 00000100:00100000:0.0:1789135805.310171:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666692864 00000100:00100000:3.0:1789135805.310185:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692992:0@lo:104: 00000100:00100000:0.0:1789135805.310187:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789135805.310200:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:10329:x1876044666692352:12345-0@lo:104: 00010000:00010000:0.0:1789135805.310213:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.310236:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135805.310263:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de28cd expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.310272:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de28cd expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.310281:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666693120:0@lo:104: 00010000:00010000:0.0:1789135805.310308:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135805.310316:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:10329:x1876044666692352:12345-0@lo:104: Request processed in 118us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.310318:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.310329:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789135805.310344:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de288e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.310347:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666692992 00000100:00100000:0.0:1789135805.310353:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666692992 00010000:00010000:3.0:1789135805.310357:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de288e expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.310369:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666693248:0@lo:104: 00000100:00100000:0.0:1789135805.310370:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693120 00000100:00100000:0.0:1789135805.310375:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693120 00000100:00100000:0.0:1789135805.310392:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135805.310398:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+8:10329:x1876044666692480:12345-0@lo:104: 00010000:00010000:0.0:1789135805.310406:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.310418:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135805.310447:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2864 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.310456:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2864 expref: 23 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.310464:0:10329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666693376:0@lo:104: 00000100:00100000:2.0:1789135805.310486:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693248 00000100:00100000:2.0:1789135805.310492:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693248 00000100:00100000:3.0:1789135805.310497:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135805.310511:0:10329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135805.310518:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789135805.310525:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1789135805.310546:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692352:0@lo:104: 00000100:00100000:3.0:1789135805.310555:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692480:0@lo:104: 00010000:00010000:1.0:1789135805.310563:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135805.310571:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310579:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135805.310584:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310592:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135805.310599:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135805.310605:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135805.310721:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310728:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789135805.310786:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666693504:0@lo:103: 00000100:00100000:2.0:1789135805.310820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135805.310936:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310945:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de297c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310959:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135805.310962:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310967:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ee00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135805.310970:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.310976:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135805.310988:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135805.310993:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789135805.311018:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.311025:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135805.311041:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.311048:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de294b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2952 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.311058:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135805.311065:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135805.311068:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135805.311083:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666693632:0@lo:103: 00000100:00100000:1.0:1789135805.311112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135805.311145:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693504 00000100:00100000:1.0:1789135805.311148:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693504 00010000:00010000:1.0:1789135805.311168:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2975 expref: 24 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135805.311187:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693632 00000100:00100000:1.0:1789135805.311189:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693632 00010000:00010000:1.0:1789135805.311199:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de294b expref: 25 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135805.311214:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135805.311219:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3639:x1876044666693504:12345-0@lo:103: 00010000:00010000:1.0:1789135805.311229:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135805.311234:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2975 expref: 25 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.311242:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2975 expref: 25 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.311254:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de297c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2975 expref: 25 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.311266:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135805.311323:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789135805.311330:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+9:10329:x1876044666692480:12345-0@lo:104: Request processed in 932us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.311336:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789135805.311356:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693376 00000100:00100000:0.0:1789135805.311359:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693376 00000100:00100000:0.0:1789135805.311373:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135805.311378:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+9:10329:x1876044666692608:12345-0@lo:104: 00010000:00010000:0.0:1789135805.311387:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.311422:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135805.311427:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+9:10329:x1876044666692608:12345-0@lo:104: Request processed in 50us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.311433:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135805.311443:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135805.311448:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c29dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+8:10329:x1876044666692736:12345-0@lo:104: 00010000:00010000:0.0:1789135805.311455:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.311479:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789135805.311483:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c29dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+8:10329:x1876044666692736:12345-0@lo:104: Request processed in 36us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.311488:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135805.311518:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135805.311524:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:10329:x1876044666692864:12345-0@lo:104: 00010000:00010000:0.0:1789135805.311531:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.311558:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789135805.311563:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+7:10329:x1876044666692864:12345-0@lo:104: Request processed in 39us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.311577:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135805.311590:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135805.311595:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:10329:x1876044666692992:12345-0@lo:104: 00010000:00010000:0.0:1789135805.311604:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.311764:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692608:0@lo:104: 00000100:00100000:3.0:1789135805.311787:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692736:0@lo:104: 00000100:00100000:3.0:1789135805.311794:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692864:0@lo:104: 00000100:00100000:3.0:1789135805.311923:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789135805.311933:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666693632:12345-0@lo:103: 00010000:00010000:3.0:1789135805.311941:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135805.311946:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de294b expref: 24 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.311954:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de294b expref: 24 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.311964:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de294b expref: 24 pid: 6508 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.311973:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135805.312004:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3640:x1876044666693632:12345-0@lo:103: Request processed in 74us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.312021:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789135805.313999:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789135805.314025:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:10329:x1876044666692992:12345-0@lo:104: Request processed in 2426us (3786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.314035:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135805.314070:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789135805.314080:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:10329:x1876044666693120:12345-0@lo:104: 00010000:00010000:0.0:1789135805.314097:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.314136:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692992:0@lo:104: 00010000:00010000:0.0:1789135805.314137:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789135805.314145:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:10329:x1876044666693120:12345-0@lo:104: Request processed in 69us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.314150:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135805.314157:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666693120:0@lo:104: 00000100:00100000:0.0:1789135805.314163:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789135805.314168:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:10329:x1876044666693248:12345-0@lo:104: 00010000:00010000:0.0:1789135805.314174:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314199:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789135805.314202:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:10329:x1876044666693248:12345-0@lo:104: Request processed in 35us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.314219:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789135805.314226:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666693248:0@lo:104: 00000100:00100000:0.0:1789135805.314235:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135805.314241:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:10329:x1876044666693376:12345-0@lo:104: 00010000:00010000:0.0:1789135805.314247:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314403:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789135805.314407:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:10329:x1876044666693376:12345-0@lo:104: Request processed in 166us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.314411:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789135805.314427:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789135805.314433:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314438:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314441:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314447:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314452:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314456:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314489:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314493:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314516:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314523:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dc400/0x559c8745c6de292f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2936 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314535:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789135805.314538:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314544:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ea00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314546:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314553:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314560:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314565:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314579:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314583:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314592:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314597:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ea00/0x559c8745c6de2905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de290c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314603:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789135805.314609:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314627:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314630:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314637:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314643:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314647:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314662:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314668:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314673:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314679:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de28e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28f0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314688:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789135805.314690:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314696:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314698:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314714:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314719:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314724:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314737:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314742:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314747:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314752:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de28db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314760:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789135805.314763:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314780:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314783:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314789:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314794:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314805:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314824:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314830:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314834:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314840:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879a00/0x559c8745c6de28cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de28d4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314850:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135805.314873:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314879:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dce00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314882:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314888:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314893:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314898:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314911:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314917:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314928:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314934:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dce00/0x559c8745c6de288e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2895 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314944:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135805.314947:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314953:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021ddc00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135805.314956:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314962:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135805.314968:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135805.314972:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789135805.314988:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.314993:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135805.314997:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315002:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021ddc00/0x559c8745c6de2864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de286b expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315027:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135805.315036:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135805.315038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135805.315056:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666693888:0@lo:103: 00000100:00100000:0.0:1789135805.315100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.315140:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666694400:0@lo:103: 00000100:00100000:0.0:1789135805.315160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.315175:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789135805.315179:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666694016:0@lo:103: 00000100:00100000:0.0:1789135805.315196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.315204:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666694528:0@lo:103: 00000100:00100000:0.0:1789135805.315219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135805.315239:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693888 00000100:00100000:0.0:1789135805.315245:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693888 00010000:00010000:0.0:1789135805.315267:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2905 expref: 23 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.315284:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694400 00000100:00100000:0.0:1789135805.315287:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694400 00010000:00010000:0.0:1789135805.315295:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de288e expref: 24 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.315304:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694016 00000100:00100000:0.0:1789135805.315306:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694016 00010000:00010000:0.0:1789135805.315314:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 25 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.315323:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694528 00000100:00100000:0.0:1789135805.315326:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694528 00010000:00010000:0.0:1789135805.315335:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2864 expref: 26 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.315359:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135805.315365:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3638:x1876044666693888:12345-0@lo:103: 00010000:00010000:0.0:1789135805.315376:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135805.315380:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2905 expref: 26 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315390:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2905 expref: 26 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315403:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dc200/0x559c8745c6de290c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2905 expref: 26 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315416:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135805.315445:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3638:x1876044666693888:12345-0@lo:103: Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.315452:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789135805.315466:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135805.315471:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666694400:12345-0@lo:103: 00010000:00010000:0.0:1789135805.315478:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135805.315482:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de288e expref: 24 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315491:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de288e expref: 24 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315500:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878400/0x559c8745c6de2895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de288e expref: 24 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315519:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135805.315541:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3638:x1876044666694400:12345-0@lo:103: Request processed in 71us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.315547:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789135805.315560:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135805.315565:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3638:x1876044666694016:12345-0@lo:103: 00010000:00010000:0.0:1789135805.315572:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135805.315576:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 22 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315583:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 22 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315593:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879600/0x559c8745c6de28f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de28e9 expref: 22 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315599:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135805.315618:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666694016:12345-0@lo:103: Request processed in 53us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.315624:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135805.315634:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135805.315640:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3638:x1876044666694528:12345-0@lo:103: 00010000:00010000:0.0:1789135805.315647:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135805.315651:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2864 expref: 20 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315659:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2864 expref: 20 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135805.315674:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135805.315697:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3638:x1876044666694528:12345-0@lo:103: Request processed in 57us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.315703:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789135805.315731:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666694016:0@lo:103: 00000100:00100000:0.0:1789135805.315739:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666694528:0@lo:103: 00000100:00100000:0.0:1789135805.315744:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666693888:0@lo:103: 00000100:00100000:0.0:1789135805.315750:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666694400:0@lo:103: 00000100:00100000:1.0:1789135805.316982:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:3639:x1876044666693504:12345-0@lo:103: Request processed in 5756us (6155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.316992:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789135805.317063:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666693760:0@lo:103: 00000100:00100000:1.0:1789135805.317101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135805.317133:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666694272:0@lo:103: 00000100:00100000:1.0:1789135805.317154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135805.317173:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135805.317179:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666694144:0@lo:103: 00000100:00100000:1.0:1789135805.317197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135805.317223:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666693760 00000100:00100000:1.0:1789135805.317228:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666693760 00010000:00010000:1.0:1789135805.317254:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de292f expref: 19 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135805.317272:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694272 00000100:00100000:1.0:1789135805.317274:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694272 00010000:00010000:1.0:1789135805.317285:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de28cd expref: 20 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135805.317294:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694144 00000100:00100000:1.0:1789135805.317296:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694144 00010000:00010000:1.0:1789135805.317305:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de28db expref: 21 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135805.317315:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135805.317321:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3641:x1876044666693760:12345-0@lo:103: 00010000:00010000:1.0:1789135805.317331:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135805.317335:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de292f expref: 21 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317345:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de292f expref: 21 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317368:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802045200/0x559c8745c6de2936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de292f expref: 21 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317382:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135805.317413:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666693760:12345-0@lo:103: Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.317420:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789135805.317446:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135805.317453:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:3641:x1876044666694272:12345-0@lo:103: 00010000:00010000:1.0:1789135805.317461:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135805.317466:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de28cd expref: 19 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317474:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de28cd expref: 19 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317484:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de28d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de28cd expref: 19 pid: 6509 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317493:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135805.317514:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:3641:x1876044666694272:12345-0@lo:103: Request processed in 62us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.317519:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789135805.317557:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135805.317564:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:3641:x1876044666694144:12345-0@lo:103: 00010000:00010000:1.0:1789135805.317572:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135805.317576:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de28db expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317590:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de28db expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317601:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dd400/0x559c8745c6de28e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de28db expref: 17 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135805.317722:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135805.317749:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:3641:x1876044666694144:12345-0@lo:103: Request processed in 186us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135805.317756:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135805.317895:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666694144:0@lo:103: 00000100:00100000:1.0:1789135805.317905:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666693760:0@lo:103: 00000100:00100000:1.0:1789135805.317912:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666694272:0@lo:103: 00000100:00100000:1.0:1789135805.317947:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666693632:0@lo:103: 00010000:00010000:1.0:1789135805.317963:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135805.318215:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030800/0x559c8745c6de286b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2864 expref: 15 pid: 6510 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.318236:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666693376:0@lo:104: 00000100:00100000:2.0:1789135805.319494:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666693504:0@lo:103: 00000100:00100000:0.0:1789135805.319632:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135805.319724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135805.319903:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644618880 00000100:00100000:2.0:1789135805.319909:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644618880 00010000:00010000:2.0:1789135805.319946:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 10 pid: 6508 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135805.320020:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619008 00000100:00100000:2.0:1789135805.320024:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619008 00010000:00010000:2.0:1789135805.320036:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 11 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135805.320056:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789135805.320064:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+11:2392:x1876044644618880:12345-192.168.201.31@tcp:103: 00010000:00010000:2.0:1789135805.320075:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135805.320080:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 11 pid: 6508 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320091:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 11 pid: 6508 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320111:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135805.320156:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+11:2392:x1876044644618880:12345-192.168.201.31@tcp:103: Request processed in 93us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.320163:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789135805.320181:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:2.0:1789135805.320189:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644619008:12345-192.168.201.31@tcp:103: 00010000:00010000:2.0:1789135805.320198:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135805.320202:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 10 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320210:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 10 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320231:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320238:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320251:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320257:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320263:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320269:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320275:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135805.320279:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320287:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320296:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135805.320307:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135805.320327:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644619008:12345-192.168.201.31@tcp:103: Request processed in 140us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.320349:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00010000:00010000:3.0:1789135805.321413:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802045400/0x559c8745c6de2991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087c4 expref: 9 pid: 6508 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.321497:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692096:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135805.321514:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de298a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087bd expref: 8 pid: 6509 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135805.321523:0:10329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1876044666692224:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135805.321569:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.321578:0:10329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.321584:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135805.321589:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135805.437543:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135805.437587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135805.437619:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135805.437650:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135805.437677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619136 00000100:00100000:0.0:1789135805.437686:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619136 00000100:00100000:0.0:1789135805.437743:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619264 00000100:00100000:0.0:1789135805.437747:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619264 00000100:00100000:0.0:1789135805.437771:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1789135805.437779:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644619136:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1789135805.437849:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644619136:12345-192.168.201.31@tcp:400: Request processed in 70us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.437888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1789135805.437905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:0.0:1789135805.437927:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644619264:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1789135805.437956:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644619264:12345-192.168.201.31@tcp:400: Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.437964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:0.0:1789135805.437983:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619392 00000100:00100000:0.0:1789135805.437986:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619392 00000100:00100000:0.0:1789135805.438021:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619520 00000100:00100000:0.0:1789135805.438024:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619520 00000100:00100000:0.0:1789135805.438042:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789135805.438048:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644619392:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1789135805.438072:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644619392:12345-192.168.201.31@tcp:400: Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.438077:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789135805.438088:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789135805.438093:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644619520:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1789135805.438112:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644619520:12345-192.168.201.31@tcp:400: Request processed in 19us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135805.438118:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00080000:0.0:1789135805.438132:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135805.438136:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135805.438139:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135805.438140:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135805.632242:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135805.800250:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135805.800279:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666694656:0@lo:13: 00000100:00100000:0.0:1789135805.800367:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135805.800683:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694656 00000100:00100000:3.0:1789135805.800691:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694656 00000100:00100000:3.0:1789135805.800748:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789135805.800769:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666694656:12345-0@lo:13: 00002000:00000024:3.0:1789135805.800802:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135805.800848:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666694656:12345-0@lo:13: Request processed in 90us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135805.800893:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789135805.801081:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666694784:0@lo:13: 00000100:00100000:0.0:1789135805.801120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789135805.801172:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d90000 x1876044666694656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.801189:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666694656:0@lo:13: 00000100:00100000:2.0:1789135805.801261:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694784 00000100:00100000:2.0:1789135805.801265:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694784 00000100:00100000:2.0:1789135805.801308:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789135805.801316:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666694784:12345-0@lo:13: 00002000:00000024:2.0:1789135805.801328:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135805.801368:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666694784:12345-0@lo:13: Request processed in 53us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135805.801374:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789135805.801496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80f00 x1876044666694784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135805.801519:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666694784:0@lo:13: 00000100:00100000:3.0:1789135806.312144:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135806.312172:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666694912:0@lo:41: 00000100:00100000:3.0:1789135806.312245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.312379:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666694912 00000100:00100000:1.0:1789135806.312388:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666694912 00000100:00100000:1.0:1789135806.312448:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135806.312458:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666694912:12345-0@lo:41: 00000004:00000024:1.0:1789135806.312504:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135806.312611:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666694912:12345-0@lo:41: Request processed in 154us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135806.312618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789135806.312663:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666694912:0@lo:41: 00010000:00010000:1.0:1789135806.698737:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135806.705516:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135806.705768:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619648 00000100:00100000:3.0:1789135806.705780:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619648 00000100:00100000:3.0:1789135806.705958:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:3.0:1789135806.705969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+8:6167:x1876044644619648:12345-192.168.201.31@tcp:101: 00010000:00010000:3.0:1789135806.705996:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135806.706025:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08834 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.706055:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08834 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.706067:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08834 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.706076:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a802044c00, rc 0) 00000100:00100000:3.0:1789135806.706136:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644619648:12345-192.168.201.31@tcp:101: Request processed in 169us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.706143:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:0.0:1789135806.714160:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135806.715046:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619776 00000100:00100000:2.0:1789135806.715058:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619776 00000100:00100000:2.0:1789135806.715134:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:2.0:1789135806.715145:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644619776:12345-192.168.201.31@tcp:501: 00000100:00100000:2.0:1789135806.715503:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644619776:12345-192.168.201.31@tcp:501: Request processed in 358us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.715514:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:0.0:1789135806.720569:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135806.720648:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644619904 00000100:00100000:3.0:1789135806.720657:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644619904 00000100:00100000:3.0:1789135806.720721:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:3.0:1789135806.720731:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644619904:12345-192.168.201.31@tcp:503: 00000100:00100000:3.0:1789135806.721085:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644619904:12345-192.168.201.31@tcp:503: Request processed in 354us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.721098:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:1.0:1789135806.728398:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135806.728622:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620032 00000100:00100000:2.0:1789135806.728633:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620032 00000100:00100000:2.0:1789135806.728697:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 205 00000100:00100000:2.0:1789135806.728708:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+9:6650:x1876044644620032:12345-192.168.201.31@tcp:502: 00000100:00100000:2.0:1789135806.728927:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+9:6650:x1876044644620032:12345-192.168.201.31@tcp:502: Request processed in 219us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.728936:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 205 00000100:00100000:0.0:1789135806.732389:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135806.732674:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620160 00000100:00100000:2.0:1789135806.732684:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620160 00000100:00100000:2.0:1789135806.732742:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:2.0:1789135806.732782:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+9:6650:x1876044644620160:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135806.732955:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+9:6650:x1876044644620160:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 176us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.732964:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:0.0:1789135806.739727:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135806.739828:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620288 00000100:00100000:3.0:1789135806.739838:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620288 00000100:00100000:3.0:1789135806.739930:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:3.0:1789135806.739941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644620288:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135806.739959:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135806.739975:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a802045400/0x559c8745c6de29de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0883b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.740014:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802045400/0x559c8745c6de29de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0883b expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.740037:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a802045400/0x559c8745c6de29de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0883b expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.740047:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a802045400, rc 0) 00000100:00100000:3.0:1789135806.740100:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620288:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 161us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.740108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:1.0:1789135806.751489:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135806.751736:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620416 00000100:00100000:0.0:1789135806.751750:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620416 00000100:00100000:0.0:1789135806.751820:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 208 00000100:00100000:0.0:1789135806.751831:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620416:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.752010:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620416:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 179us (534us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135806.752026:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 208 10000000:01000000:3.0:1789135806.889595:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789135806.889604:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6c2291000 from 48 10000000:01000000:3.0:1789135806.889610:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789135806.889662:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.889674:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.889706:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.889733:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695040:0@lo:101: 00000100:00100000:3.0:1789135806.889809:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.889902:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.890089:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695040 00000100:00100000:2.0:1789135806.890097:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695040 00000100:00100000:2.0:1789135806.890159:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789135806.890170:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+15:6513:x1876044666695040:12345-0@lo:101: 00010000:00010000:2.0:1789135806.890184:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135806.890196:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167d600/0x559c8745c6de29ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de29e5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.890230:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167d600/0x559c8745c6de29ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de29e5 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.890241:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167d600/0x559c8745c6de29ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de29e5 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.890251:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d600, rc 0) 00000100:00100000:2.0:1789135806.890300:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666695040:12345-0@lo:101: Request processed in 131us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.890306:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789135806.890844:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695040:0@lo:101: 00010000:00010000:3.0:1789135806.890878:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.890888:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.890951:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695168:0@lo:501: 00000100:00100000:3.0:1789135806.890992:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.891031:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.891144:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695168 00000100:00100000:0.0:1789135806.891150:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695168 00000100:00100000:0.0:1789135806.891189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789135806.891196:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666695168:12345-0@lo:501: 00000100:00100000:0.0:1789135806.891337:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666695168:12345-0@lo:501: Request processed in 141us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.891345:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789135806.892665:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695168:0@lo:501: 00000100:00100000:3.0:1789135806.892716:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695296:0@lo:503: 00000100:00100000:3.0:1789135806.892776:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.892827:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.892910:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695296 00000100:00100000:2.0:1789135806.892915:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695296 00000100:00100000:2.0:1789135806.892964:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789135806.892972:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666695296:12345-0@lo:503: 00000100:00100000:2.0:1789135806.893097:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666695296:12345-0@lo:503: Request processed in 125us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.893112:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789135806.893142:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695296:0@lo:503: 00000100:00100000:0.0:1789135806.893905:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10347:1876044666695424:0@lo:502: 00000100:00100000:0.0:1789135806.893950:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.893993:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.894055:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695424 00000100:00100000:2.0:1789135806.894060:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695424 00000100:00100000:2.0:1789135806.894094:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789135806.894101:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:10347:x1876044666695424:12345-0@lo:502: 00000100:00100000:2.0:1789135806.894190:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:10347:x1876044666695424:12345-0@lo:502: Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.894197:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789135806.895238:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10347:1876044666695424:0@lo:502: 00000100:00100000:0.0:1789135806.895300:0:10347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10347:1876044666695552:0@lo:502: 00000100:00100000:0.0:1789135806.895361:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.895405:0:10347:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.895539:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695552 00000100:00100000:2.0:1789135806.895544:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695552 00000100:00100000:2.0:1789135806.895585:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789135806.895594:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:10347:x1876044666695552:12345-0@lo:502: 00000100:00100000:2.0:1789135806.895697:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+16:10347:x1876044666695552:12345-0@lo:502: Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.895704:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789135806.895932:0:10347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10347:1876044666695552:0@lo:502: 00000040:00080000:0.0:1789135806.895954:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789135806.896139:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789135806.896159:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135806.896170:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.896180:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135806.896197:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789135806.896199:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789135806.896202:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789135806.896226:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.896234:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.896243:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.896257:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695680:0@lo:101: 00000100:00100000:3.0:1789135806.896289:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.896321:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135806.896447:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695680 00000100:00100000:1.0:1789135806.896451:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695680 00000100:00100000:1.0:1789135806.896488:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789135806.896496:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+16:6513:x1876044666695680:12345-0@lo:101: 00010000:00010000:1.0:1789135806.896506:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135806.896517:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de29fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de29f3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.896539:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de29fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de29f3 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.896549:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de29fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de29f3 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.896556:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878a00, rc 0) 00000100:00100000:1.0:1789135806.896599:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666695680:12345-0@lo:101: Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135806.896605:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789135806.896679:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695680:0@lo:101: 00010000:00010000:0.0:1789135806.896703:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135806.896712:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135806.896766:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695808:0@lo:501: 00000100:00100000:0.0:1789135806.896794:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.896816:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135806.896995:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695808 00000100:00100000:1.0:1789135806.896999:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695808 00000100:00100000:1.0:1789135806.897020:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789135806.897026:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666695808:12345-0@lo:501: 00000100:00100000:1.0:1789135806.897130:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666695808:12345-0@lo:501: Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135806.897148:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789135806.897237:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695808:0@lo:501: 00000100:00100000:0.0:1789135806.897262:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695936:0@lo:503: 00000100:00100000:0.0:1789135806.897295:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.897316:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.897326:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666695936 00000100:00100000:0.0:1789135806.897340:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666695936 00000100:00100000:0.0:1789135806.897356:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789135806.897367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666695936:12345-0@lo:503: 00000100:00100000:0.0:1789135806.897430:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666695936:12345-0@lo:503: Request processed in 63us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.897436:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789135806.897466:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666695936:0@lo:503: 00000100:00100000:1.0:1789135806.900061:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10348:1876044666696064:0@lo:502: 00000100:00100000:1.0:1789135806.900146:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.900196:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.900352:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696064 00000100:00100000:0.0:1789135806.900359:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696064 00000100:00100000:0.0:1789135806.900399:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789135806.900408:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:10348:x1876044666696064:12345-0@lo:502: 00000100:00100000:0.0:1789135806.900512:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+17:10348:x1876044666696064:12345-0@lo:502: Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.900520:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789135806.900728:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10348:1876044666696064:0@lo:502: 00000020:01000000:1.0:1789135806.900767:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135806.900777:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135806.900780:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789135806.900787:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789135806.900811:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10348:1876044666696192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135806.900848:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.900898:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.901031:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696192 00000100:00100000:2.0:1789135806.901036:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696192 00000100:00100000:2.0:1789135806.901068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789135806.901075:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:10348:x1876044666696192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.901152:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+17:10348:x1876044666696192:12345-0@lo:502:llog_process_th.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.901158:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789135806.901429:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10348:1876044666696192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135806.901449:0:10348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135806.901453:0:10348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135806.901455:0:10348:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789135806.901459:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789135806.901628:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789135806.901649:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789135806.901658:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.901693:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135806.901705:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789135806.901707:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7e761a000 from 48 10000000:01000000:2.0:1789135806.901710:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135806.901738:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.901746:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.901767:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135806.901783:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.901816:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135806.901880:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.902001:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696320 00000100:00100000:3.0:1789135806.902007:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696320 00000100:00100000:3.0:1789135806.902052:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789135806.902060:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+17:6513:x1876044666696320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135806.902069:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135806.902081:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a802044400/0x559c8745c6de2a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a01 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.902101:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a802044400/0x559c8745c6de2a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a01 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.902111:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a802044400/0x559c8745c6de2a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a01 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.902130:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a802044400, rc 0) 00000100:00100000:3.0:1789135806.902166:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666696320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.902172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789135806.902377:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135806.902389:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.902399:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135806.902446:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.902474:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.902499:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.902603:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696448 00000100:00100000:3.0:1789135806.902607:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696448 00000100:00100000:3.0:1789135806.902625:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789135806.902631:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666696448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.902732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666696448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.902738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789135806.903141:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.903167:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.903201:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.903335:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.906814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696576 00000100:00100000:3.0:1789135806.906829:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696576 00000100:00100000:3.0:1789135806.906913:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789135806.906923:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666696576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.907103:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666696576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.907110:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789135806.907738:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.908326:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10349:1876044666696704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.908389:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135806.908429:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.908526:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696704 00000100:00100000:0.0:1789135806.908531:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696704 00000100:00100000:0.0:1789135806.908562:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789135806.908568:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:10349:x1876044666696704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.908673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+18:10349:x1876044666696704:12345-0@lo:502:llog_process_th.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.908680:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789135806.909001:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10349:1876044666696704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.909052:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10349:1876044666696832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.909084:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135806.909121:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.909168:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696832 00000100:00100000:0.0:1789135806.909173:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696832 00000100:00100000:0.0:1789135806.909205:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789135806.909220:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:10349:x1876044666696832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.909295:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:10349:x1876044666696832:12345-0@lo:502:llog_process_th.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.909301:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789135806.909478:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10349:1876044666696832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789135806.909499:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789135806.910413:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789135806.910442:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789135806.910453:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135806.910465:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135806.910474:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789135806.910476:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789135806.910479:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789135806.910510:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135806.910518:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135806.910528:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135806.910543:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.910583:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.910620:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135806.910662:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666696960 00000100:00100000:1.0:1789135806.910667:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666696960 00000100:00100000:1.0:1789135806.910694:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789135806.910701:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+18:6513:x1876044666696960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135806.910711:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135806.910722:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de2a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a0f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.910745:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de2a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a0f expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.910765:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de2a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a0f expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.910774:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879c00, rc 0) 00000100:00100000:1.0:1789135806.910809:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666696960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135806.910815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789135806.911111:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666696960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135806.911125:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135806.911134:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135806.911200:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.911236:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.911255:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.911421:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697088 00000100:00100000:2.0:1789135806.911425:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697088 00000100:00100000:2.0:1789135806.911456:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789135806.911464:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666697088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.911582:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666697088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.911590:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789135806.912128:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.912161:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.912208:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.912312:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.912445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697216 00000100:00100000:3.0:1789135806.912450:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697216 00000100:00100000:3.0:1789135806.912483:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789135806.912490:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666697216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.912608:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666697216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.912614:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789135806.912832:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.921547:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10350:1876044666697344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.921624:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.921678:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.922163:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697344 00000100:00100000:2.0:1789135806.922171:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697344 00000100:00100000:2.0:1789135806.922230:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789135806.922239:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:10350:x1876044666697344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.922368:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+19:10350:x1876044666697344:12345-0@lo:502:llog_process_th.0 Request processed in 130us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.922377:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789135806.922457:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10350:1876044666697344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135806.922486:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135806.922494:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135806.922497:0:10350:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789135806.922502:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789135806.922521:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10350:1876044666697472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.922552:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.922579:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.922874:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697472 00000100:00100000:3.0:1789135806.922879:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697472 00000100:00100000:3.0:1789135806.922910:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789135806.922916:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+19:10350:x1876044666697472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135806.922991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+19:10350:x1876044666697472:12345-0@lo:502:llog_process_th.0 Request processed in 75us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.922998:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789135806.923491:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10350:1876044666697472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135806.923516:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135806.923521:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135806.923523:0:10350:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789135806.923532:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789135806.923908:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789135806.923926:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789135806.923936:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.923946:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135806.923955:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789135806.923958:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7fa5f7000 from 48 10000000:01000000:3.0:1789135806.923961:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789135806.924029:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.924037:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.924046:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.924062:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.924098:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.924142:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.924361:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697600 00000100:00100000:2.0:1789135806.924366:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697600 00000100:00100000:2.0:1789135806.924408:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789135806.924416:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+19:6513:x1876044666697600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135806.924426:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135806.924437:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167d800/0x559c8745c6de2a24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a1d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.924458:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167d800/0x559c8745c6de2a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a1d expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.924469:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167d800/0x559c8745c6de2a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a1d expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.924487:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d800, rc 0) 00000100:00100000:2.0:1789135806.924534:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666697600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.924540:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789135806.924722:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135806.924734:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.924741:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.924801:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.924828:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.924851:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.925147:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697728 00000100:00100000:2.0:1789135806.925151:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697728 00000100:00100000:2.0:1789135806.925184:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789135806.925191:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666697728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.925343:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666697728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.925350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789135806.927571:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.927631:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.927710:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.927746:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.927892:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697856 00000100:00100000:2.0:1789135806.927898:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697856 00000100:00100000:2.0:1789135806.927946:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789135806.927955:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666697856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.928097:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666697856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.928106:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789135806.928218:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6888f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666697856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.929206:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10351:1876044666697984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.929264:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.929305:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.929473:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666697984 00000100:00100000:3.0:1789135806.929479:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666697984 00000100:00100000:3.0:1789135806.929510:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789135806.929517:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:10351:x1876044666697984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135806.929636:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:10351:x1876044666697984:12345-0@lo:502:llog_process_th.0 Request processed in 119us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.929644:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789135806.930014:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10351:1876044666697984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.930304:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10351:1876044666698112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.930353:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.930388:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.930495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698112 00000100:00100000:2.0:1789135806.930500:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698112 00000100:00100000:2.0:1789135806.930540:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789135806.930547:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:10351:x1876044666698112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.930636:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:10351:x1876044666698112:12345-0@lo:502:llog_process_th.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.930642:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789135806.930989:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10351:1876044666698112:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789135806.931013:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789135806.931203:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789135806.931232:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789135806.931243:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.931253:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135806.931273:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789135806.931275:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789135806.931278:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789135806.931306:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.931313:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.931323:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.931349:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.931389:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.931427:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.931534:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698240 00000100:00100000:2.0:1789135806.931539:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698240 00000100:00100000:2.0:1789135806.931581:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789135806.931588:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666698240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135806.931598:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135806.931609:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167d000/0x559c8745c6de2a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a2b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.931630:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167d000/0x559c8745c6de2a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a2b expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.931641:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167d000/0x559c8745c6de2a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a2b expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.931648:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d000, rc 0) 00000100:00100000:2.0:1789135806.931688:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666698240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.931694:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789135806.931773:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135806.931786:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.931802:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135806.931889:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.931919:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.931937:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.932078:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698368 00000100:00100000:2.0:1789135806.932082:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698368 00000100:00100000:2.0:1789135806.932106:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789135806.932112:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666698368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.932210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666698368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.932216:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789135806.932374:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.932405:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.932443:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.932465:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.932580:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698496 00000100:00100000:2.0:1789135806.932584:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698496 00000100:00100000:2.0:1789135806.932619:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789135806.932625:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666698496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.932709:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666698496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.932716:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789135806.938232:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.939046:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10352:1876044666698624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135806.939117:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.939154:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.939768:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698624 00000100:00100000:2.0:1789135806.939776:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698624 00000100:00100000:2.0:1789135806.939829:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789135806.939838:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10352:x1876044666698624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.940007:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10352:x1876044666698624:12345-0@lo:502:llog_process_th.0 Request processed in 169us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.940015:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789135806.940241:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10352:1876044666698624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135806.940271:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135806.940281:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135806.940283:0:10352:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789135806.940289:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789135806.940315:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10352:1876044666698752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.940362:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.940386:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.940618:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698752 00000100:00100000:2.0:1789135806.940623:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698752 00000100:00100000:2.0:1789135806.940655:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789135806.940661:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10352:x1876044666698752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.940747:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10352:x1876044666698752:12345-0@lo:502:llog_process_th.0 Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.940762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789135806.940972:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10352:1876044666698752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135806.941009:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135806.941013:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135806.941015:0:10352:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789135806.941019:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789135806.941415:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789135806.941439:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789135806.941448:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.941458:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135806.941467:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789135806.941470:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7d26b4800 from 48 10000000:01000000:2.0:1789135806.941479:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789135806.941507:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.941515:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.941524:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135806.941540:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.941576:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135806.941611:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.941667:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666698880 00000100:00100000:3.0:1789135806.941673:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666698880 00000100:00100000:3.0:1789135806.941718:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789135806.941725:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666698880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135806.941735:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135806.941747:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de2a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a39 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.941779:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de2a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a39 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.941797:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de2a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a39 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.941806:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f400, rc 0) 00000100:00100000:3.0:1789135806.941848:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666698880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.941880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789135806.942052:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666698880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135806.942066:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135806.942074:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135806.942134:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.942163:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.942184:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.942511:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699008 00000100:00100000:2.0:1789135806.942516:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699008 00000100:00100000:2.0:1789135806.942556:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789135806.942564:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666699008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.942672:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666699008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.942691:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789135806.943079:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.943116:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.943166:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.943189:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.943447:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699136 00000100:00100000:3.0:1789135806.943452:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699136 00000100:00100000:3.0:1789135806.943490:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789135806.943498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666699136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.943576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666699136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.943582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789135806.944084:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.944725:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10353:1876044666699264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.944791:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.944831:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.944999:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699264 00000100:00100000:3.0:1789135806.945006:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699264 00000100:00100000:3.0:1789135806.945056:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789135806.945063:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10353:x1876044666699264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135806.945166:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10353:x1876044666699264:12345-0@lo:502:llog_process_th.0 Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.945173:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789135806.945553:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10353:1876044666699264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.945593:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10353:1876044666699392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.945630:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135806.945650:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.945708:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699392 00000100:00100000:2.0:1789135806.945713:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699392 00000100:00100000:2.0:1789135806.945745:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789135806.945759:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10353:x1876044666699392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135806.945831:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10353:x1876044666699392:12345-0@lo:502:llog_process_th.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.945838:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789135806.946047:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10353:1876044666699392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789135806.946065:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789135806.946435:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789135806.946462:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789135806.946470:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.946481:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135806.946490:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789135806.946492:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789135806.946495:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789135806.946528:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.946535:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.946545:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135806.946558:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135806.946587:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135806.946647:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135806.952325:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699520 00000100:00100000:1.0:1789135806.952351:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699520 00000100:00100000:2.0:1789135806.953574:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789135806.953586:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666699520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135806.953603:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135806.953622:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94c200/0x559c8745c6de2a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a47 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.953651:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94c200/0x559c8745c6de2a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a47 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.953693:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94c200/0x559c8745c6de2a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a47 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.953704:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94c200, rc 0) 00000100:00100000:2.0:1789135806.954795:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666699520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1207us (8202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135806.954806:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789135806.954937:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135806.954962:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.954998:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135806.955085:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.955126:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.959660:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.959818:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699648 00000100:00100000:0.0:1789135806.959827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699648 00000100:00100000:0.0:1789135806.960231:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789135806.960241:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666699648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.960503:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666699648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (5375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.960511:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789135806.960595:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.960639:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.960699:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.960728:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.960776:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699776 00000100:00100000:0.0:1789135806.960780:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699776 00000100:00100000:0.0:1789135806.960796:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789135806.960802:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666699776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135806.960899:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666699776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.960905:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789135806.961194:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666699776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.961729:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10354:1876044666699904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135806.961846:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.961908:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135806.961991:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666699904 00000100:00100000:0.0:1789135806.961996:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666699904 00000100:00100000:0.0:1789135806.962306:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789135806.962316:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10354:x1876044666699904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135806.962434:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10354:x1876044666699904:12345-0@lo:502:llog_process_th.0 Request processed in 120us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135806.962441:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789135806.962510:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10354:1876044666699904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135806.962534:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135806.962542:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135806.962544:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789135806.962550:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789135806.962570:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10354:1876044666700032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135806.962601:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135806.962889:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135806.962972:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700032 00000100:00100000:1.0:1789135806.962987:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700032 00000100:00100000:1.0:1789135806.963333:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789135806.963345:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10354:x1876044666700032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135806.963460:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10354:x1876044666700032:12345-0@lo:502:llog_process_th.0 Request processed in 118us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135806.963468:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789135806.963633:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10354:1876044666700032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135806.963666:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135806.963672:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135806.963674:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789135806.963679:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789135806.963957:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789135806.963987:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789135806.963998:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.964393:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135806.964407:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789135806.964410:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a7efa18000 from 1 10000000:01000000:1.0:1789135806.964414:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789135806.964446:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.964454:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.964464:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135806.964483:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666700160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.964525:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.964602:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135806.964704:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700160 00000100:00100000:2.0:1789135806.964710:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700160 00000100:00100000:3.0:1789135806.964765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789135806.964775:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666700160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135806.964785:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135806.964798:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de2a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a55 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.964820:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de2a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a55 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.964830:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de2a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a55 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135806.964838:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ea00, rc 0) 00000100:00100000:3.0:1789135806.964889:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666700160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135806.964896:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789135806.965415:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666700160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135806.965430:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135806.965440:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135806.965499:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666700288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135806.965527:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135806.965573:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135806.965621:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700288 00000100:00100000:3.0:1789135806.965625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700288 00000100:00100000:3.0:1789135806.965692:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789135806.965700:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666700288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135806.965849:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666700288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (320us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135806.965883:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789135806.966562:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666700288:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789135806.966595:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789135806.966603:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135806.966611:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135807.720127:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135808.754101:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789135809.012829:0:10392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4fa1d780 20000000:00000080:1.0:1789135809.012848:0:10392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a6c2b53800 uarg=0000000000000000 20000000:01000000:1.0:1789135809.013849:0:10392:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789135809.013927:0:10392:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789135809.013932:0:10392:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789135809.015367:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789135809.015541:0:10392:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789135809.020588:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789135809.020625:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789135809.020638:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789135809.020667:0:10392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789135809.020685:0:10392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020703:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020712:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2706 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020787:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de275a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020795:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2880 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020805:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020813:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020904:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.020919:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 9 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.020934:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700416:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135809.021054:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2880 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.021064:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2880 expref: 23 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.021074:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700544:0@lo:104: 00000100:00100000:1.0:1789135809.021110:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135809.021141:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de275a expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.021149:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de275a expref: 23 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.021157:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700672:0@lo:104: 00000100:00100000:1.0:1789135809.021204:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135809.021231:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2706 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.021241:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2706 expref: 23 pid: 6509 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.021259:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700800:0@lo:104: 00010000:00010000:1.0:1789135809.021285:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135809.021305:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 23 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.021313:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700928:0@lo:104: 00000100:00100000:1.0:1789135809.021330:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135809.021664:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789135809.021682:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.021707:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.021723:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700544 00000100:00100000:2.0:1789135809.021729:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700544 00000100:00100000:2.0:1789135809.021764:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700672 00000100:00100000:2.0:1789135809.021767:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700672 00000100:00100000:2.0:1789135809.021775:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700800 00000100:00100000:2.0:1789135809.021777:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700800 00000100:00100000:2.0:1789135809.021785:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666700928 00000100:00100000:2.0:1789135809.021793:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666700928 00000100:00100000:2.0:1789135809.021807:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789135809.021814:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+6:10392:x1876044666700544:12345-0@lo:104: 00010000:00010000:2.0:1789135809.021826:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.021892:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135809.021898:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+6:10392:x1876044666700544:12345-0@lo:104: Request processed in 85us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.021905:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789135809.021922:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135809.021928:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+5:10392:x1876044666700672:12345-0@lo:104: 00010000:00010000:2.0:1789135809.021935:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.021984:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789135809.021989:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+5:10392:x1876044666700672:12345-0@lo:104: Request processed in 62us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.021995:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789135809.022021:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135809.022027:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:10392:x1876044666700800:12345-0@lo:104: 00010000:00010000:2.0:1789135809.022034:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022056:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789135809.022060:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:10392:x1876044666700800:12345-0@lo:104: Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.022066:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135809.022082:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135809.022088:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:10392:x1876044666700928:12345-0@lo:104: 00010000:00010000:2.0:1789135809.022095:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022119:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789135809.022123:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:10392:x1876044666700928:12345-0@lo:104: Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.022128:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1789135809.022144:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789135809.022151:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022157:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ec00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135809.022161:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022170:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135809.022184:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135809.022189:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135809.022218:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022224:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135809.022244:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022261:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ec00/0x559c8745c6de2880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2887 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022275:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789135809.022278:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022283:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135809.022286:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022305:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135809.022312:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135809.022317:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135809.022333:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022340:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135809.022356:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022362:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dc600/0x559c8745c6de275a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2761 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022372:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789135809.022381:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022387:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ce00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135809.022390:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022396:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135809.022402:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135809.022407:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135809.022420:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022426:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135809.022431:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022436:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de2706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de270d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022447:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135809.022449:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022454:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135809.022456:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022471:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135809.022477:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135809.022482:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135809.022494:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022500:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135809.022506:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022512:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de26f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de26ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022525:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135809.022526:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135809.022528:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135809.022540:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666701056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.022567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.022588:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135809.022593:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666701440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.022608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.022629:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666701184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.022647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.022661:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135809.022671:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666701312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.022704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135809.022725:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701056 00000100:00100000:2.0:1789135809.022728:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701056 00010000:00010000:2.0:1789135809.022748:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2880 expref: 24 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135809.022762:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701440 00000100:00100000:2.0:1789135809.022765:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701440 00010000:00010000:2.0:1789135809.022774:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 25 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135809.022783:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701184 00000100:00100000:2.0:1789135809.022785:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701184 00010000:00010000:2.0:1789135809.022792:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de275a expref: 26 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135809.022801:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701312 00000100:00100000:2.0:1789135809.022803:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701312 00010000:00010000:2.0:1789135809.022810:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2706 expref: 27 pid: 6509 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135809.022820:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135809.022826:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+27:3639:x1876044666701056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135809.022834:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135809.022839:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2880 expref: 27 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022848:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2880 expref: 27 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022895:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135809.022920:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+27:3639:x1876044666701056:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.022927:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789135809.022952:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135809.022959:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3639:x1876044666701440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135809.022965:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135809.022970:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 26 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022978:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 26 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.022987:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135809.023005:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3639:x1876044666701440:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.023011:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135809.023022:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135809.023027:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3640:x1876044666701184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135809.023033:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135809.023037:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de275a expref: 25 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.023044:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de275a expref: 25 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.023052:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135809.023078:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3640:x1876044666701184:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.023084:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135809.023094:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135809.023100:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666701312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135809.023106:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135809.023110:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2706 expref: 24 pid: 6509 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.023118:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2706 expref: 24 pid: 6509 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.023127:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135809.023146:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666701312:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135809.023152:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135809.023214:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666701440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.023223:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666701056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.023247:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666701312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789135809.023254:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666701184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135809.024658:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135809.024810:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2880 expref: 23 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.024825:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700544:0@lo:104: 00010000:00010000:1.0:1789135809.024837:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878000/0x559c8745c6de2761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de275a expref: 22 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.024847:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700672:0@lo:104: 00010000:00010000:1.0:1789135809.024870:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167de00/0x559c8745c6de270d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2706 expref: 21 pid: 6509 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.024879:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700800:0@lo:104: 00010000:00010000:1.0:1789135809.024889:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167da00/0x559c8745c6de26ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de26f8 expref: 20 pid: 6508 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135809.024897:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700928:0@lo:104: 00000100:00100000:1.0:1789135809.029491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135809.029566:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620544 00000100:00100000:0.0:1789135809.029575:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620544 00010000:00010000:0.0:1789135809.029624:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 10 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135809.029677:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1789135809.029686:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644620544:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135809.029701:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135809.029708:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 10 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029730:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 10 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029753:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029762:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029778:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029786:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029793:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029799:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029806:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135809.029817:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029825:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029835:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135809.029846:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135809.029928:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644620544:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 241us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135809.029936:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00010000:00010000:3.0:1789135809.031168:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802045c00/0x559c8745c6de299f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087fc expref: 9 pid: 6508 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135809.031264:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1876044666700416:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135809.031803:0:10392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135809.031816:0:10392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135809.031823:0:10392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135809.031828:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2a63 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135809.769495:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135809.896345:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666701568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135809.896437:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135809.896536:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701568 00000100:00100000:3.0:1789135809.896545:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701568 00000100:00100000:3.0:1789135809.896605:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789135809.896616:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666701568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135809.896655:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135809.896726:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666701568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135809.896734:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789135809.896754:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666701568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135810.293238:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135810.294802:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620672 00000100:00100000:0.0:1789135810.294816:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620672 00000100:00100000:0.0:1789135810.294910:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 251 00000100:00100000:0.0:1789135810.294929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+9:6167:x1876044644620672:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135810.294950:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135810.294973:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08842 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.295001:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.295013:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.295023:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:0.0:1789135810.295090:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620672:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 171us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.295109:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 251 00000100:00100000:1.0:1789135810.307591:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135810.307828:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620800 00000100:00100000:3.0:1789135810.307838:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620800 00000100:00100000:3.0:1789135810.307911:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 252 00000100:00100000:3.0:1789135810.307932:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620800:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135810.308085:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620800:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 155us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.308102:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 252 00000100:00100000:1.0:1789135810.330008:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135810.330081:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644620928 00000100:00100000:2.0:1789135810.330104:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644620928 00000100:00100000:2.0:1789135810.330156:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 253 00000100:00100000:2.0:1789135810.330167:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620928:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.330326:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:6167:x1876044644620928:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 160us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.330335:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 253 00000100:00100000:3.0:1789135810.342391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135810.344363:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621056 00000100:00100000:2.0:1789135810.344379:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621056 00000100:00100000:2.0:1789135810.344452:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 254 00000100:00100000:2.0:1789135810.344462:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:6710:x1876044644621056:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135810.344618:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:6710:x1876044644621056:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 156us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.344628:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 254 00000100:00100000:3.0:1789135810.356161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135810.356463:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621184 00000100:00100000:0.0:1789135810.356473:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621184 00000100:00100000:0.0:1789135810.356532:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 255 00000100:00100000:0.0:1789135810.356542:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6710:x1876044644621184:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135810.356686:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:6710:x1876044644621184:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 144us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.356704:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 255 00000100:00100000:2.0:1789135810.409143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666701952:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.409231:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.409290:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666702464:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.409318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.409336:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666702976:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.409355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.409386:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789135810.409392:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666702080:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.409393:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666701696:0@lo:400:kworker.0 00000100:00100000:0.0:1789135810.410099:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666701824:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.410302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.410331:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666702592:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.410364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.410382:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666703104:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.410415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.410453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701952 00000100:00100000:2.0:1789135810.410460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701952 00000100:00100000:2.0:1789135810.410508:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135810.410518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666701952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.410572:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666701952:12345-0@lo:400:kworker.0 Request processed in 55us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.410579:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135810.410600:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702464 00000100:00100000:2.0:1789135810.410603:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702464 00000100:00100000:2.0:1789135810.410626:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702976 00000100:00100000:2.0:1789135810.410629:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702976 00000100:00100000:2.0:1789135810.410638:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702592 00000100:00100000:2.0:1789135810.410640:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702592 00000100:00100000:2.0:1789135810.410649:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703104 00000100:00100000:2.0:1789135810.410651:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703104 00000100:00100000:2.0:1789135810.410662:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135810.410667:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666702464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.411631:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666702464:12345-0@lo:400:kworker.0 Request processed in 959us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.411641:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789135810.411667:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135810.411679:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666702976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.411798:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666702976:12345-0@lo:400:kworker.0 Request processed in 124us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.411805:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789135810.411818:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135810.411824:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666702592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.411879:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666702592:12345-0@lo:400:kworker.0 Request processed in 55us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.411885:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789135810.411897:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789135810.411903:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666703104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.411941:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666703104:12345-0@lo:400:kworker.0 Request processed in 38us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.411947:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789135810.412015:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702080 00000100:00100000:2.0:1789135810.412020:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702080 00000100:00100000:2.0:1789135810.412056:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789135810.412062:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666702080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.412094:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666702080:12345-0@lo:400:kworker.0 Request processed in 33us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.412100:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789135810.412122:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135810.412127:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135810.415827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.415935:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666702208:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.416005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.416035:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666702720:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.416059:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.416090:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666703232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135810.416113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.416198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702208 00000100:00100000:3.0:1789135810.417838:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702208 00000100:00100000:3.0:1789135810.417956:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702720 00000100:00100000:3.0:1789135810.417961:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702720 00000100:00100000:3.0:1789135810.417991:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789135810.418002:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666702208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.418092:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666702208:12345-0@lo:400:kworker.0 Request processed in 92us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.418100:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789135810.418118:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135810.418124:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666702720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.418152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666702720:12345-0@lo:400:kworker.0 Request processed in 28us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.418157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135810.418201:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703232 00000100:00100000:3.0:1789135810.418239:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703232 00000100:00100000:3.0:1789135810.418799:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789135810.418809:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666703232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135810.418832:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135810.418895:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666703232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.418902:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789135810.419034:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135810.419070:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ec1a40 x1876044666703232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135810.419091:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666703232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135810.419105:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666702208:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.419116:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666702720:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.419139:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135810.419154:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666703360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135810.419188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.419672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.419702:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666702336:0@lo:400:kworker.0 00000100:00100000:0.0:1789135810.419726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.419756:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666702848:0@lo:400:kworker.0 00000100:00100000:0.0:1789135810.419777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.420400:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703360 00000100:00100000:3.0:1789135810.420406:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703360 00000100:00100000:3.0:1789135810.420450:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789135810.420458:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666703360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135810.420474:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135810.420517:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666703360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.420523:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789135810.420558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701824 00000100:00100000:3.0:1789135810.420561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701824 00000100:00100000:3.0:1789135810.420584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702336 00000100:00100000:3.0:1789135810.420587:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702336 00000100:00100000:3.0:1789135810.420605:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666702848 00000100:00100000:3.0:1789135810.420608:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666702848 00000100:00100000:3.0:1789135810.420633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789135810.420641:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666701824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.420677:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666701824:12345-0@lo:400:kworker.0 Request processed in 38us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.420683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789135810.420695:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135810.420701:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666702336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135810.420982:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666701824:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.421109:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666702336:12345-0@lo:400:kworker.0 Request processed in 408us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.421117:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135810.421133:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135810.421140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666702848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.421168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666702848:12345-0@lo:400:kworker.0 Request processed in 29us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.421173:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789135810.421196:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789135810.421229:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d93480 x1876044666703360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135810.421247:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666703360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135810.422303:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666701696 00000100:00100000:2.0:1789135810.422311:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666701696 00000100:00100000:2.0:1789135810.422357:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789135810.422367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3640:x1876044666701696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.422415:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3640:x1876044666701696:12345-0@lo:400:kworker.0 Request processed in 50us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.422422:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789135810.422468:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666702080:0@lo:400:kworker.0 00010000:00080000:2.0:1789135810.422482:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e81a40 x1876044666702592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135810.422501:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666702592:0@lo:400:kworker.0 00010000:00080000:2.0:1789135810.422513:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82d00 x1876044666703104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135810.422521:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666703104:0@lo:400:kworker.0 00000100:00100000:2.0:1789135810.422533:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666701952:0@lo:400:kworker.0 00010000:00080000:2.0:1789135810.422542:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80780 x1876044666702464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135810.422551:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666702464:0@lo:400:kworker.0 00010000:00080000:2.0:1789135810.422561:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82940 x1876044666702976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135810.422569:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666702976:0@lo:400:kworker.0 00000100:00100000:3.0:1789135810.423530:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666701696:0@lo:400:kworker.0 00010000:00080000:0.0:1789135810.427894:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83c00 x1876044666702336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135810.427924:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666702336:0@lo:400:kworker.0 00010000:00080000:3.0:1789135810.433478:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80f00 x1876044666702848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135810.433499:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666702848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135810.547306:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135810.547338:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135810.547362:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135810.547378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135810.547396:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135810.547422:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621440 00000100:00100000:1.0:1789135810.547430:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621440 00000100:00100000:1.0:1789135810.547478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621568 00000100:00100000:1.0:1789135810.547480:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621568 00000100:00100000:1.0:1789135810.547500:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:1.0:1789135810.547509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644621440:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135810.547576:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644621440:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.547584:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:1.0:1789135810.547600:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1789135810.547606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644621568:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135810.547625:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644621568:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.547631:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1789135810.547646:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621696 00000100:00100000:1.0:1789135810.547649:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621696 00000100:00100000:1.0:1789135810.547668:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621824 00000100:00100000:1.0:1789135810.547670:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621824 00000100:00100000:1.0:1789135810.548782:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:1.0:1789135810.548804:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644621696:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135810.548873:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644621696:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 78us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.548880:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:1.0:1789135810.548902:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1789135810.548909:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644621824:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135810.548942:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644621824:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 35us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.548948:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1789135810.548970:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621312 00000100:00100000:1.0:1789135810.548975:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621312 00000100:00100000:1.0:1789135810.549004:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 257 00000100:00100000:1.0:1789135810.549010:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2389:x1876044644621312:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135810.549033:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2389:x1876044644621312:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.549039:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 257 00000100:00080000:1.0:1789135810.549072:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135810.549077:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135810.549080:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135810.549083:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1789135810.602274:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135810.602283:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c2291000 from 4 10000000:01000000:1.0:1789135810.602288:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135810.602336:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.602348:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.602376:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135810.602401:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666703488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.602472:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.602529:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135810.602593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703488 00000100:00100000:3.0:1789135810.602600:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703488 00000100:00100000:3.0:1789135810.602656:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789135810.602666:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666703488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135810.602679:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135810.602702:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a71 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135810.602726:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135810.602735:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135810.602744:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f200, rc 0) 00000100:00100000:3.0:1789135810.602784:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666703488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.602791:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789135810.602976:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666703488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135810.602990:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.602998:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135810.603059:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666703616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.603083:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.603105:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135810.603152:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703616 00000100:00100000:3.0:1789135810.603156:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703616 00000100:00100000:3.0:1789135810.603185:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789135810.603192:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666703616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135810.603293:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666703616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.603311:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789135810.603436:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666703616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.603462:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666703744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.603498:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.603519:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135810.603555:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703744 00000100:00100000:3.0:1789135810.603559:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703744 00000100:00100000:3.0:1789135810.603585:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789135810.603591:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666703744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135810.603665:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666703744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.603672:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789135810.603804:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666703744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.606966:0:10459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10459:1876044666703872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.607053:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.607096:0:10459:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135810.607171:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666703872 00000100:00100000:3.0:1789135810.607178:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666703872 00000100:00100000:3.0:1789135810.607215:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789135810.607224:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10459:x1876044666703872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135810.607327:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10459:x1876044666703872:12345-0@lo:502:llog_process_th.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135810.607335:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789135810.607707:0:10459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10459:1876044666703872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135810.607736:0:10459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135810.607746:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135810.607748:0:10459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135810.607754:0:10459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c2291000 00000020:00000080:2.0:1789135810.607757:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135810.607834:0:10459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10459:1876044666704000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.607896:0:10459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.607945:0:10459:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135810.614286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704000 00000100:00100000:1.0:1789135810.614301:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704000 00000100:00100000:1.0:1789135810.614366:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789135810.614377:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10459:x1876044666704000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135810.614546:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:10459:x1876044666704000:12345-0@lo:502:llog_process_th.0 Request processed in 170us (6649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.614554:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789135810.622116:0:10459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10459:1876044666704000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135810.622177:0:10459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135810.622187:0:10459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135810.622190:0:10459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135810.622195:0:10459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789135810.622905:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789135810.622942:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135810.622953:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.622965:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135810.622986:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135810.622989:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7e761a000 from 4 10000000:01000000:0.0:1789135810.622992:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135810.623029:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.623036:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.623046:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135810.623067:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.623134:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.623191:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135810.623212:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704128 00000100:00100000:0.0:1789135810.623218:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704128 00000100:00100000:0.0:1789135810.623263:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789135810.623273:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666704128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135810.623286:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135810.623298:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a7f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.623321:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.623331:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.623350:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031400, rc 0) 00000100:00100000:0.0:1789135810.623387:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666704128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.623394:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789135810.623436:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135810.623450:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.623459:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135810.623508:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.623531:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.623544:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa180 going to sleep for 11 seconds 00000100:00100000:0.0:1789135810.623556:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704256 00000100:00100000:0.0:1789135810.623559:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704256 00000100:00100000:0.0:1789135810.623577:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789135810.623582:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666704256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.623680:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666704256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.623687:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789135810.623717:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.623745:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.623782:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.623801:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7348600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135810.623812:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704384 00000100:00100000:0.0:1789135810.623815:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704384 00000100:00100000:0.0:1789135810.623834:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789135810.623840:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666704384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.623953:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666704384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.623960:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789135810.624002:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135810.630807:0:10462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10462:1876044666704512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135810.631486:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.632289:0:10462:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135810.638273:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704512 00000100:00100000:0.0:1789135810.638287:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704512 00000100:00100000:0.0:1789135810.638343:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789135810.638353:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10462:x1876044666704512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135810.638508:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10462:x1876044666704512:12345-0@lo:502:llog_process_th.0 Request processed in 157us (7023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.638516:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789135810.638663:0:10462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10462:1876044666704512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135810.638697:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135810.638708:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135810.638710:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789135810.638718:0:10462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7e761a000 00000020:00000080:3.0:1789135810.638721:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135810.638816:0:10462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10462:1876044666704640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135810.639039:0:10462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135810.639086:0:10462:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135810.640333:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704640 00000100:00100000:1.0:1789135810.640343:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704640 00000100:00100000:1.0:1789135810.640505:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789135810.640515:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10462:x1876044666704640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135810.640635:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:10462:x1876044666704640:12345-0@lo:502:llog_process_th.0 Request processed in 121us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.640642:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789135810.643303:0:10462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10462:1876044666704640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135810.643344:0:10462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135810.643352:0:10462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135810.643355:0:10462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789135810.643360:0:10462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789135810.643705:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789135810.643728:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135810.643739:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.643751:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135810.643761:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135810.643764:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 4 10000000:01000000:0.0:1789135810.643766:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135810.643801:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.643816:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.643827:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135810.643847:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135810.643958:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.643999:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7348b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135810.645269:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704768 00000100:00100000:1.0:1789135810.645277:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704768 00000100:00100000:1.0:1789135810.645327:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789135810.645336:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666704768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135810.645350:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135810.645363:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a8d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.645387:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.645397:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.645406:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135810.645460:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666704768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.645478:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789135810.645533:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135810.645547:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.645557:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135810.645616:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.645643:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.645660:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135810.645671:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666704896 00000100:00100000:1.0:1789135810.645674:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666704896 00000100:00100000:1.0:1789135810.645693:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789135810.645698:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666704896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.645792:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666704896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.645799:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789135810.645824:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666704896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.645847:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.645900:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.645923:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135810.645934:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705024 00000100:00100000:1.0:1789135810.645937:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705024 00000100:00100000:1.0:1789135810.645960:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789135810.645973:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666705024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.646050:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666705024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135810.646056:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789135810.646096:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.657564:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10466:1876044666705152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.658050:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.658097:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135810.660151:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705152 00000100:00100000:2.0:1789135810.660162:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705152 00000100:00100000:2.0:1789135810.660222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789135810.660232:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10466:x1876044666705152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.660399:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10466:x1876044666705152:12345-0@lo:502:llog_process_th.0 Request processed in 168us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.660407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789135810.660470:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10466:1876044666705152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135810.660503:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135810.660513:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135810.660516:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135810.660523:0:10466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7fa5f7000 00000020:00000080:2.0:1789135810.660525:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135810.660999:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10466:1876044666705280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.661040:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.661067:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135810.661318:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705280 00000100:00100000:0.0:1789135810.661323:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705280 00000100:00100000:0.0:1789135810.661352:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789135810.661359:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10466:x1876044666705280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135810.661435:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:10466:x1876044666705280:12345-0@lo:502:llog_process_th.0 Request processed in 75us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.661442:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789135810.661554:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10466:1876044666705280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135810.661573:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135810.661582:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135810.661584:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135810.661587:0:10466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789135810.665227:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789135810.665274:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135810.665287:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.665300:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135810.665313:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135810.665316:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 4 10000000:01000000:1.0:1789135810.665319:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135810.665360:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.665369:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135810.665381:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135810.665406:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135810.665469:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135810.665526:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135810.665748:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705408 00000100:00100000:2.0:1789135810.665755:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705408 00000100:00100000:2.0:1789135810.665803:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789135810.665813:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666705408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135810.665825:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135810.665837:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2a9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.665879:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.665891:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.665899:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94ce00, rc 0) 00000100:00100000:2.0:1789135810.665947:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666705408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.665954:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789135810.665999:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135810.666012:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.666021:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135810.666074:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.666111:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.666124:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135810.666136:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705536 00000100:00100000:2.0:1789135810.666139:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705536 00000100:00100000:2.0:1789135810.666174:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789135810.666179:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666705536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.666282:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666705536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.666288:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789135810.666315:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.666343:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.666380:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.666393:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135810.666404:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705664 00000100:00100000:2.0:1789135810.666408:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705664 00000100:00100000:2.0:1789135810.666427:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789135810.666433:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666705664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.666495:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666705664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.666502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789135810.666536:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666705664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135810.666823:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10467:1876044666705792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.666874:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.666891:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705792 00000100:00100000:2.0:1789135810.666899:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705792 00000100:00100000:2.0:1789135810.666931:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789135810.666937:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:10467:x1876044666705792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.666993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:10467:x1876044666705792:12345-0@lo:502:llog_process_th.0 Request processed in 55us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.666999:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789135810.667024:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135810.667035:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10467:1876044666705792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135810.667054:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135810.667061:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135810.667064:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789135810.667070:0:10467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7d26b4800 00000020:00000080:2.0:1789135810.667072:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135810.667495:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10467:1876044666705920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.667527:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.667547:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666705920 00000100:00100000:2.0:1789135810.667550:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666705920 00000100:00100000:2.0:1789135810.667570:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789135810.667575:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:10467:x1876044666705920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135810.667708:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:10467:x1876044666705920:12345-0@lo:502:llog_process_th.0 Request processed in 132us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135810.667715:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789135810.667744:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135810.667756:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:10467:1876044666705920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135810.667775:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135810.667779:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135810.667785:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789135810.667789:0:10467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789135810.667841:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789135810.667879:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135810.667886:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135810.667896:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135810.792028:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135810.931231:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666706048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135810.931405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135810.931469:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135810.931476:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666706176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135810.931495:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135810.931637:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706048 00000100:00100000:0.0:1789135810.931645:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706048 00000100:00100000:0.0:1789135810.931694:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706176 00000100:00100000:0.0:1789135810.931697:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706176 00000100:00100000:0.0:1789135810.931713:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135810.931722:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666706048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135810.931752:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135810.931803:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666706048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.931810:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789135810.931840:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789135810.931846:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666706176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135810.931886:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135810.931929:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666706176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135810.931935:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789135810.931968:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92580 x1876044666706176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135810.931987:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666706176:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789135810.931997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8c780 x1876044666706048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135810.932006:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666706048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135811.432850:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666706304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135811.432956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135811.433106:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706304 00000100:00100000:1.0:1789135811.433120:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706304 00000100:00100000:1.0:1789135811.433292:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789135811.433302:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666706304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135811.433339:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135811.433426:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666706304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135811.433434:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135811.439831:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666706304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135811.819910:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135812.840198:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135813.870007:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135814.900940:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135815.021064:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666706432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135815.021192:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135815.021292:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706432 00000100:00100000:3.0:1789135815.021298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706432 00000100:00100000:3.0:1789135815.021345:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135815.021354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666706432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135815.021392:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135815.021439:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666706432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135815.021446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135815.021494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666706432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135815.531168:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135815.531206:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666706560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135815.531300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135815.531560:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706560 00000100:00100000:3.0:1789135815.531569:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706560 00000100:00100000:3.0:1789135815.531733:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789135815.531743:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666706560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135815.531773:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135815.531831:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666706560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135815.531840:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789135815.531899:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91a40 x1876044666706560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135815.531916:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666706560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135815.532150:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666706688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135815.532179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135815.532260:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706688 00000100:00100000:0.0:1789135815.532265:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706688 00000100:00100000:0.0:1789135815.532301:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789135815.532309:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666706688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135815.532321:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135815.532353:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666706688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135815.532358:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789135815.532421:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8cb40 x1876044666706688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135815.532434:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666706688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789135815.532633:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135815.544777:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666706816:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.544888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.544931:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666707328:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.544958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.544978:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666707840:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545074:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135815.545081:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666706944:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545104:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545119:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666707456:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545153:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666707968:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545201:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666707072:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545224:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545239:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666707584:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545300:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789135815.545306:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666707200:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545355:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666707712:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545371:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135815.545391:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707328 00000100:00100000:1.0:1789135815.545396:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707328 00000100:00100000:1.0:1789135815.545438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706944 00000100:00100000:1.0:1789135815.545441:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706944 00000100:00100000:1.0:1789135815.545451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707456 00000100:00100000:1.0:1789135815.545453:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707456 00000100:00100000:1.0:1789135815.545462:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707072 00000100:00100000:1.0:1789135815.545464:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707072 00000100:00100000:1.0:1789135815.545472:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707584 00000100:00100000:1.0:1789135815.545474:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707584 00000100:00100000:1.0:1789135815.545482:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707712 00000100:00100000:1.0:1789135815.545484:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707712 00000100:00100000:1.0:1789135815.545495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135815.545502:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666707328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545545:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666707328:12345-0@lo:400:kworker.0 Request processed in 43us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545551:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135815.545567:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789135815.545573:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666706944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545594:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666706944:12345-0@lo:400:kworker.0 Request processed in 22us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789135815.545608:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789135815.545612:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666707456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545644:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666707456:12345-0@lo:400:kworker.0 Request processed in 32us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545649:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789135815.545659:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135815.545664:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666707072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545691:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666707072:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545695:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135815.545706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789135815.545712:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666707584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666707584:12345-0@lo:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545741:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789135815.545752:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789135815.545757:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666707712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666707712:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789135815.545806:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707840 00000100:00100000:1.0:1789135815.545810:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707840 00000100:00100000:1.0:1789135815.545845:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707968 00000100:00100000:1.0:1789135815.545849:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707968 00000100:00100000:1.0:1789135815.545888:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135815.545894:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666707840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666707840:12345-0@lo:400:kworker.0 Request processed in 31us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545943:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789135815.545955:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135815.545961:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666707968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.545991:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666707968:12345-0@lo:400:kworker.0 Request processed in 31us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.545996:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789135815.546032:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666707200 00000100:00100000:1.0:1789135815.546035:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666707200 00000100:00100000:1.0:1789135815.546062:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789135815.546068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666707200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.546111:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666707200:12345-0@lo:400:kworker.0 Request processed in 42us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.546117:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789135815.546133:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135815.546137:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135815.546139:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135815.546179:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666707200:0@lo:400:kworker.0 00010000:00080000:1.0:1789135815.546192:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe0b40 x1876044666707712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135815.546203:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666707712:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.546215:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666707072:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.546223:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666707584:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.546259:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666706944:0@lo:400:kworker.0 00010000:00080000:1.0:1789135815.546269:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe12c0 x1876044666707456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135815.546284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666707456:0@lo:400:kworker.0 00010000:00080000:1.0:1789135815.546295:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f843c0 x1876044666707968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135815.546303:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666707968:0@lo:400:kworker.0 00000100:00100000:1.0:1789135815.546313:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666707328:0@lo:400:kworker.0 00010000:00080000:1.0:1789135815.546322:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f861c0 x1876044666707840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135815.546329:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666707840:0@lo:400:kworker.0 00000100:00100000:2.0:1789135815.548966:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666706816 00000100:00100000:2.0:1789135815.548983:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666706816 00000100:00100000:2.0:1789135815.549045:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789135815.549066:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666706816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135815.549158:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666706816:12345-0@lo:400:kworker.0 Request processed in 104us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135815.549166:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789135815.549227:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666706816:0@lo:400:kworker.0 00000100:00100000:3.0:1789135815.681094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135815.681141:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135815.681168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622208 00000100:00100000:3.0:1789135815.681179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622208 00000100:00100000:3.0:1789135815.681246:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:3.0:1789135815.681256:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644622208:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135815.681331:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644622208:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135815.681342:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00080000:3.0:1789135815.681364:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135815.681393:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135815.681523:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135815.681544:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135815.681564:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622464 00000100:00100000:3.0:1789135815.681568:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622464 00000100:00100000:3.0:1789135815.681600:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622336 00000100:00100000:3.0:1789135815.681603:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622336 00000100:00100000:3.0:1789135815.681623:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789135815.681629:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644622464:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135815.681663:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644622464:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135815.681670:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789135815.681682:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:3.0:1789135815.681687:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644622336:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135815.681708:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644622336:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135815.681714:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:3.0:1789135815.681729:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622080 00000100:00100000:3.0:1789135815.681732:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622080 00000100:00100000:3.0:1789135815.682270:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:3.0:1789135815.682277:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644622080:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135815.682304:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644622080:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135815.682310:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:1.0:1789135815.682524:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644621952 00000100:00100000:1.0:1789135815.682529:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644621952 00000100:00100000:1.0:1789135815.682561:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 279 00000100:00100000:1.0:1789135815.682568:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644621952:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135815.682595:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644621952:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135815.682601:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 279 00000100:00080000:1.0:1789135815.682921:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135815.682926:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135815.682928:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789135815.912343:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135816.043053:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666708096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135816.043135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135816.046903:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135816.046928:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666708224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135816.047012:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135816.047089:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708096 00000100:00100000:1.0:1789135816.047098:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708096 00000100:00100000:1.0:1789135816.047145:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708224 00000100:00100000:1.0:1789135816.047148:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708224 00000100:00100000:1.0:1789135816.047164:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789135816.047172:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666708096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135816.047203:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135816.047251:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666708096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (4115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135816.047258:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789135816.047276:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789135816.047282:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666708224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789135816.047291:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135816.047314:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666708224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135816.047320:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789135816.047360:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d90000 x1876044666708224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135816.047380:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666708224:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789135816.047391:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92d00 x1876044666708096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135816.047402:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666708096:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789135816.293418:0:10693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1789135816.556230:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666708352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135816.556313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135816.556427:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708352 00000100:00100000:2.0:1789135816.556435:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708352 00000100:00100000:2.0:1789135816.556487:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789135816.556497:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666708352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135816.556539:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135816.556636:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666708352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135816.556643:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789135816.556686:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666708352:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135816.940704:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135817.961046:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135818.984137:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135820.008018:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135820.136046:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135820.136069:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666708480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135820.136148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135820.136224:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708480 00000100:00100000:3.0:1789135820.136231:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708480 00000100:00100000:3.0:1789135820.136272:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789135820.136280:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666708480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135820.136311:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135820.136351:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666708480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135820.136357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789135820.136396:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666708480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135820.648083:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666708864:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135820.648217:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666709376:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135820.648278:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666709888:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135820.648331:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135820.648337:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666708992:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135820.648374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666709504:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648394:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135820.648408:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666710016:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135820.648460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708864 00000100:00100000:1.0:1789135820.648467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708864 00000100:00100000:1.0:1789135820.648528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789135820.648538:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666708864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648586:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666708864:12345-0@lo:400:kworker.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.648592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789135820.648613:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709376 00000100:00100000:1.0:1789135820.648616:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709376 00000100:00100000:1.0:1789135820.648639:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709888 00000100:00100000:1.0:1789135820.648641:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709888 00000100:00100000:1.0:1789135820.648652:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709504 00000100:00100000:1.0:1789135820.648654:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709504 00000100:00100000:1.0:1789135820.648663:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710016 00000100:00100000:1.0:1789135820.648673:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710016 00000100:00100000:1.0:1789135820.648689:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135820.648694:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666709376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648725:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666709376:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.648741:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789135820.648753:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789135820.648759:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666709888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648785:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666709888:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.648791:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789135820.648803:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135820.648808:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666709504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.648832:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666709504:12345-0@lo:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.648838:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789135820.648998:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789135820.649004:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666710016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.649030:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666710016:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.649036:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789135820.649059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708992 00000100:00100000:1.0:1789135820.649063:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708992 00000100:00100000:1.0:1789135820.649091:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135820.649097:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666708992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.649128:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666708992:12345-0@lo:400:kworker.0 Request processed in 31us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.649141:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789135820.649170:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135820.649174:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135820.649204:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666708992:0@lo:400:kworker.0 00010000:00080000:1.0:1789135820.649216:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ef480 x1876044666709504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135820.649227:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666709504:0@lo:400:kworker.0 00010000:00080000:1.0:1789135820.649236:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe0b40 x1876044666710016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135820.649245:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666710016:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.649255:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666708864:0@lo:400:kworker.0 00010000:00080000:1.0:1789135820.649262:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ee580 x1876044666709376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135820.649270:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666709376:0@lo:400:kworker.0 00010000:00080000:1.0:1789135820.649277:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe0000 x1876044666709888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135820.649285:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666709888:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649653:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666708736:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135820.649714:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666709248:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135820.649763:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666709760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135820.649800:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789135820.649806:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666708608:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135820.649886:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666709120:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135820.649934:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666709632:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.649955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135820.650133:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708608 00000100:00100000:2.0:1789135820.650139:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708608 00000100:00100000:2.0:1789135820.650172:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789135820.650179:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666708608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135820.650217:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666708608:12345-0@lo:400:kworker.0 Request processed in 39us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135820.650222:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789135820.650259:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666708608:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.651806:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666708736 00000100:00100000:1.0:1789135820.651817:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666708736 00000100:00100000:1.0:1789135820.651874:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709248 00000100:00100000:1.0:1789135820.651877:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709248 00000100:00100000:1.0:1789135820.651977:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709760 00000100:00100000:1.0:1789135820.651981:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709760 00000100:00100000:1.0:1789135820.651993:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709120 00000100:00100000:1.0:1789135820.652003:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709120 00000100:00100000:1.0:1789135820.652016:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666709632 00000100:00100000:1.0:1789135820.652018:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666709632 00000100:00100000:1.0:1789135820.652032:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135820.652039:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666708736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.652105:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666708736:12345-0@lo:400:kworker.0 Request processed in 66us (2418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.652111:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135820.652127:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135820.652133:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666709248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.652161:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666709248:12345-0@lo:400:kworker.0 Request processed in 28us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.652167:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135820.652178:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789135820.652184:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666709760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.652209:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666709760:12345-0@lo:400:kworker.0 Request processed in 26us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.652216:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789135820.652226:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789135820.652233:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666709120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.652259:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666709120:12345-0@lo:400:kworker.0 Request processed in 27us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.652265:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789135820.652275:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789135820.652281:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666709632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.652306:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666709632:12345-0@lo:400:kworker.0 Request processed in 26us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.652319:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789135820.652343:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135820.652347:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135820.655902:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666710144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135820.655984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135820.656079:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666709120:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.656092:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666709632:0@lo:400:kworker.0 00000100:00100000:0.0:1789135820.656103:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666708736:0@lo:400:kworker.0 00010000:00080000:0.0:1789135820.656116:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c96d21c0 x1876044666709248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135820.656152:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666709248:0@lo:400:kworker.0 00010000:00080000:0.0:1789135820.656168:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe12c0 x1876044666709760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135820.656176:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666709760:0@lo:400:kworker.0 00000100:00100000:1.0:1789135820.658048:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710144 00000100:00100000:1.0:1789135820.658061:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710144 00000100:00100000:1.0:1789135820.658129:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789135820.658140:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666710144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135820.658172:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135820.658246:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666710144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.658253:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789135820.658296:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92d00 x1876044666710144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135820.658316:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666710144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135820.658528:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135820.658541:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666710272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135820.658576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135820.658651:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710272 00000100:00100000:2.0:1789135820.658656:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710272 00000100:00100000:2.0:1789135820.658687:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135820.658694:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666710272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135820.658704:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135820.658752:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666710272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135820.658758:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789135820.658824:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ec21c0 x1876044666710272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135820.658837:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666710272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135820.793577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135820.793619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135820.793643:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135820.793671:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622848 00000100:00100000:0.0:1789135820.793681:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622848 00000100:00100000:0.0:1789135820.793748:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622720 00000100:00100000:0.0:1789135820.793751:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622720 00000100:00100000:0.0:1789135820.793775:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:0.0:1789135820.793786:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644622848:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135820.793881:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644622848:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 97us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135820.793889:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:0.0:1789135820.793905:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:0.0:1789135820.793911:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644622720:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135820.793932:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644622720:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135820.793950:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00080000:0.0:1789135820.793969:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135820.793973:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135820.795096:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622592 00000100:00100000:3.0:1789135820.795106:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622592 00000100:00100000:3.0:1789135820.795168:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 281 00000100:00100000:3.0:1789135820.795177:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644622592:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135820.795232:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644622592:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 56us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135820.795240:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 281 00000100:00100000:3.0:1789135820.805057:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135820.805095:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135820.805964:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644622976 00000100:00100000:0.0:1789135820.805976:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644622976 00000100:00100000:0.0:1789135820.806610:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623104 00000100:00100000:0.0:1789135820.806615:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623104 00000100:00100000:1.0:1789135820.806707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:1.0:1789135820.806719:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2388:x1876044644622976:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:1.0:1789135820.806764:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de29b4 00000100:00080000:1.0:1789135820.806775:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a28800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135820.806819:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789135820.807007:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+2:2388:x1876044644622976:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 289us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135820.807015:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00010000:00010000:1.0:1789135820.807073:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789135820.811427:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135820.811439:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135820.812792:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:0.0:1789135820.812805:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2388:x1876044644623104:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:0.0:1789135820.812841:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de29bb 00000100:00080000:0.0:1789135820.812851:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a28000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789135820.812912:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789135820.813067:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+2:2388:x1876044644623104:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 264us (7970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135820.813075:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00010000:00010000:0.0:1789135820.813097:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135821.036566:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789135821.062980:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing yml_node 00000100:00100000:1.0:1789135821.161023:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666710400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135821.161094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135821.161277:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710400 00000100:00100000:0.0:1789135821.161284:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710400 00000100:00100000:0.0:1789135821.161330:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789135821.161338:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666710400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135821.161370:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135821.161408:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666710400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135821.161414:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1789135821.161452:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3cf00 x1876044666710400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135821.161468:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666710400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135821.161491:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135821.161497:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666710528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135821.161521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135821.161552:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710528 00000100:00100000:0.0:1789135821.161555:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710528 00000100:00100000:0.0:1789135821.161576:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789135821.161581:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666710528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135821.161592:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135821.161621:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666710528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135821.161627:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789135821.161652:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8cb40 x1876044666710528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135821.161663:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666710528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135821.677218:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666710656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135821.677304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135821.677389:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710656 00000100:00100000:1.0:1789135821.677397:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710656 00000100:00100000:1.0:1789135821.677442:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135821.677451:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666710656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135821.677487:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135821.677534:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666710656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135821.677541:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135821.678135:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666710656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135822.056042:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135823.080222:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135824.105954:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135825.128119:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135825.256309:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666710784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135825.256387:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135825.256884:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710784 00000100:00100000:3.0:1789135825.256894:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710784 00000100:00100000:3.0:1789135825.256950:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789135825.256961:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666710784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135825.256994:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135825.257052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666710784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.257071:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789135825.257165:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666710784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135825.768129:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666711168:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768202:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.768267:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666711680:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.768320:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666712192:0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.768353:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666711040:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768354:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135825.768395:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.768412:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789135825.768420:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666711296:0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.768439:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666711552:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768453:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135825.768472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.768482:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666711808:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.768529:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666712320:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.768585:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711168 00000100:00100000:1.0:1789135825.768592:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711168 00000100:00100000:1.0:1789135825.768647:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711040 00000100:00100000:1.0:1789135825.768650:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711040 00000100:00100000:1.0:1789135825.768664:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711552 00000100:00100000:1.0:1789135825.768666:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711552 00000100:00100000:1.0:1789135825.768689:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789135825.768697:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666711168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768746:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666711168:12345-0@lo:400:kworker.0 Request processed in 49us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.768753:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789135825.768770:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135825.768776:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666711040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768803:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666711040:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.768809:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789135825.768822:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789135825.768825:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666712064:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768832:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666711552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.768890:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666711552:12345-0@lo:400:kworker.0 Request processed in 61us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.768905:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135825.768927:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711680 00000100:00100000:1.0:1789135825.768930:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711680 00000100:00100000:1.0:1789135825.768948:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712192 00000100:00100000:1.0:1789135825.768950:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712192 00000100:00100000:1.0:1789135825.768960:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711808 00000100:00100000:1.0:1789135825.768961:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711808 00000100:00100000:1.0:1789135825.768972:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712320 00000100:00100000:1.0:1789135825.768975:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712320 00000100:00100000:1.0:1789135825.768990:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789135825.768996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.769002:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666711680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.769039:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666711040:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769046:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666711680:12345-0@lo:400:kworker.0 Request processed in 44us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.769054:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789135825.769058:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3c000 x1876044666711552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135825.769071:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135825.769072:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666711552:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769084:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666712192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.769091:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789135825.769099:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666710912:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769121:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666712192:12345-0@lo:400:kworker.0 Request processed in 39us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.769128:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135825.769133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.769148:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789135825.769157:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666711808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.769165:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666711424:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769201:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666711808:12345-0@lo:400:kworker.0 Request processed in 46us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135825.769209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135825.769215:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135825.769227:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666711936:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769232:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789135825.769241:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666712320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.769247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135825.769267:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712064 00000100:00100000:2.0:1789135825.769272:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712064 00000100:00100000:1.0:1789135825.769294:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666712320:12345-0@lo:400:kworker.0 Request processed in 52us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.769302:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135825.769308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711424 00000100:00100000:2.0:1789135825.769312:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711424 00000100:00100000:2.0:1789135825.769328:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711936 00000100:00100000:2.0:1789135825.769330:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711936 00000100:00100000:2.0:1789135825.769342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789135825.769346:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666711296 00000100:00100000:2.0:1789135825.769350:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666712064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769353:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666711296 00000100:00100000:1.0:1789135825.769392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789135825.769394:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666712064:12345-0@lo:400:kworker.0 Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.769403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666711296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135825.769426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135825.769445:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789135825.769451:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666711296:12345-0@lo:400:kworker.0 Request processed in 50us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135825.769456:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666711424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769464:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789135825.769501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789135825.769509:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666711936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769544:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666711936:12345-0@lo:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135825.769550:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789135825.769582:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666711296:0@lo:400:kworker.0 00010000:00080000:1.0:1789135825.769593:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3d680 x1876044666711808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135825.769602:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666711808:0@lo:400:kworker.0 00010000:00080000:1.0:1789135825.769611:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c23121c0 x1876044666712320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135825.769618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666712320:0@lo:400:kworker.0 00000100:00100000:1.0:1789135825.769627:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666711168:0@lo:400:kworker.0 00010000:00080000:1.0:1789135825.769634:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3cb40 x1876044666711680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135825.769683:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666711680:0@lo:400:kworker.0 00010000:00080000:1.0:1789135825.769695:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3cf00 x1876044666712192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135825.769701:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666712192:0@lo:400:kworker.0 00000100:00080000:3.0:1789135825.769831:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135825.769836:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135825.769837:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135825.769840:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135825.769897:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666710912 00000100:00100000:3.0:1789135825.769901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666710912 00000100:00100000:3.0:1789135825.769939:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789135825.769947:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666710912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.769981:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666710912:12345-0@lo:400:kworker.0 Request processed in 36us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.769987:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789135825.770032:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666710912:0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.770043:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666711424:0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.770054:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666711936:0@lo:400:kworker.0 00010000:00080000:3.0:1789135825.770063:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3de00 x1876044666712064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135825.770071:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666712064:0@lo:400:kworker.0 00000100:00100000:3.0:1789135825.770085:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135825.770090:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666712448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135825.770118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135825.770146:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712448 00000100:00100000:3.0:1789135825.770149:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712448 00000100:00100000:3.0:1789135825.770175:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789135825.770181:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666712448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135825.770211:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135825.770245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666712448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.770251:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789135825.770276:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91e00 x1876044666712448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135825.770289:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666712448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135825.770954:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666711424:12345-0@lo:400:kworker.0 Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135825.770964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789135825.771188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666712576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135825.771225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135825.771267:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712576 00000100:00100000:2.0:1789135825.771273:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712576 00000100:00100000:2.0:1789135825.773318:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789135825.773341:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666712576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135825.773368:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135825.780056:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666712576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6715us (8818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135825.780072:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789135825.780089:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91e00 x1876044666712576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135825.780117:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666712576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135825.908795:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135825.908905:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135825.908948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135825.908989:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623488 00000100:00100000:3.0:1789135825.908998:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623488 00000100:00100000:3.0:1789135825.909055:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623360 00000100:00100000:3.0:1789135825.909058:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623360 00000100:00100000:3.0:1789135825.909083:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:3.0:1789135825.909092:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644623488:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135825.909113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:0.0:1789135825.909121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644623360:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135825.909163:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644623488:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135825.909171:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:2.0:1789135825.913630:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623232 00000100:00100000:2.0:1789135825.913655:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623232 00000100:00100000:2.0:1789135825.913729:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 283 00000100:00100000:2.0:1789135825.913740:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2389:x1876044644623232:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135825.914530:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644623360:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 5403us (5574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135825.914553:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00080000:3.0:1789135825.920472:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135825.920483:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135825.925795:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2389:x1876044644623232:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 12042us (16996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135825.925813:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 283 00010000:00010000:0.0:1789135826.151986:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135826.280840:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135826.280881:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666712704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135826.280936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135826.280989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712704 00000100:00100000:1.0:1789135826.280995:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712704 00000100:00100000:1.0:1789135826.281038:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135826.281047:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666712704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135826.281077:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135826.281123:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666712704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135826.281130:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789135826.281174:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f688ad00 x1876044666712704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135826.281192:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666712704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135826.282012:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666712832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135826.282054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135826.282272:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712832 00000100:00100000:2.0:1789135826.282278:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712832 00000100:00100000:3.0:1789135826.284231:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135826.284244:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666712832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135826.284279:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135826.284371:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666712832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135826.284390:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789135826.287824:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83840 x1876044666712832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135826.287870:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666712832:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1789135826.328731:0:11120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.127 00000100:00100000:3.0:1789135826.794193:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666712960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135826.794268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135826.795719:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666712960 00000100:00100000:2.0:1789135826.795732:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666712960 00000100:00100000:2.0:1789135826.795800:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789135826.795809:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666712960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135826.795850:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135826.796048:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666712960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 239us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135826.796057:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135826.796116:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666712960:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789135826.797122:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:3.0:1789135826.797129:0:9511:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2d000/50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:2.0:1789135826.797223:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2d000/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-OST0001 00000020:00000080:2.0:1789135826.797401:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3a28000 for lustre-OST0001 00000001:00100000:1.0:1789135826.798223:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:1.0:1789135826.798228:0:8425:0:(genops.c:885:class_export_put()) final put ffff90a6c3a29800/50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:3.0:1789135826.798281:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a29800/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-OST0000 00000020:00000080:3.0:1789135826.798320:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3a28800 for lustre-OST0000 00010000:00010000:1.0:1789135827.181258:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135828.200393:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135829.228378:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135829.305631:0:11217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.127 00010000:00010000:0.0:1789135830.247989:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135830.376223:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135830.376246:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666713088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135830.376313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135830.376434:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713088 00000100:00100000:3.0:1789135830.376442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713088 00000100:00100000:3.0:1789135830.376495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789135830.376504:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666713088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135830.376538:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135830.376595:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666713088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.376603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789135830.376691:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666713088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135830.888238:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666713344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135830.888302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135830.888384:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135830.888392:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666713216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135830.888414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.888488:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713344 00000100:00100000:0.0:1789135830.888498:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713344 00000100:00100000:0.0:1789135830.888565:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713216 00000100:00100000:0.0:1789135830.888568:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713216 00000100:00100000:0.0:1789135830.888593:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789135830.888601:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666713344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135830.888640:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135830.888690:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666713344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.888697:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789135830.888725:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789135830.888732:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666713216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135830.888741:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135830.888763:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666713216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.888769:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789135830.889185:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666713728:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.889222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135830.889250:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666714240:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.889276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135830.889292:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666714752:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.889312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135830.889340:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789135830.889346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666713856:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.889368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135830.889383:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666714368:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.889421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135830.889494:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713728 00000100:00100000:3.0:1789135830.889499:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713728 00000100:00100000:3.0:1789135830.889536:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135830.889552:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666713728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.889592:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666713728:12345-0@lo:400:kworker.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.889598:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789135830.889724:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714240 00000100:00100000:3.0:1789135830.889728:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714240 00000100:00100000:3.0:1789135830.889763:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713856 00000100:00100000:3.0:1789135830.889766:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713856 00000100:00100000:3.0:1789135830.889777:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714368 00000100:00100000:3.0:1789135830.889792:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714368 00000100:00100000:3.0:1789135830.889807:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789135830.889813:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666714240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.889846:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666714240:12345-0@lo:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.889878:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789135830.889890:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789135830.889895:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666713856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.889921:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666713856:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.889927:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789135830.889936:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789135830.889942:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666714368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.889965:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666714368:12345-0@lo:400:kworker.0 Request processed in 24us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.889971:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789135830.890176:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666713472:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.890258:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666713984:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890282:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.890299:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666714496:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.890349:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789135830.890354:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666713600:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890374:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.890386:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666714112:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.890415:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666714624:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135830.890463:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714496 00000100:00100000:0.0:1789135830.890467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714496 00000100:00100000:0.0:1789135830.890488:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713600 00000100:00100000:0.0:1789135830.890491:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713600 00000100:00100000:0.0:1789135830.890501:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714112 00000100:00100000:0.0:1789135830.890503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714112 00000100:00100000:0.0:1789135830.890516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789135830.890522:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666714496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890569:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666714496:12345-0@lo:400:kworker.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.890575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789135830.890590:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789135830.890597:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666713600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890623:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666713600:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.890629:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789135830.890640:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135830.890647:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666714112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890684:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666714112:12345-0@lo:400:kworker.0 Request processed in 38us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135830.890690:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135830.890881:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666713600:0@lo:400:kworker.0 00000100:00100000:0.0:1789135830.890894:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666714112:0@lo:400:kworker.0 00010000:00080000:0.0:1789135830.890907:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83480 x1876044666714496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135830.890918:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666714496:0@lo:400:kworker.0 00000100:00080000:1.0:1789135830.891002:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135830.891008:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135830.891010:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135830.891021:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714752 00000100:00100000:1.0:1789135830.891025:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714752 00000100:00100000:1.0:1789135830.891071:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714624 00000100:00100000:1.0:1789135830.891074:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714624 00000100:00100000:1.0:1789135830.891093:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135830.891099:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666714752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135830.891134:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666714752:12345-0@lo:400:kworker.0 Request processed in 36us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135830.891139:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135830.891151:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135830.891157:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666714624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135830.891189:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666714624:12345-0@lo:400:kworker.0 Request processed in 32us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135830.891195:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789135830.891229:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e812c0 x1876044666713216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135830.891247:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666713216:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789135830.891259:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c96d21c0 x1876044666713344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135830.891284:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666713344:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789135830.891313:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83c00 x1876044666714624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135830.891321:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666714624:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.891841:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713984 00000100:00100000:2.0:1789135830.891846:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713984 00000100:00100000:2.0:1789135830.891921:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789135830.891929:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666713984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.891974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666713984:12345-0@lo:400:kworker.0 Request processed in 47us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135830.891981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789135830.892017:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666713856:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.892029:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666714368:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.892040:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666713728:0@lo:400:kworker.0 00010000:00080000:2.0:1789135830.892051:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80000 x1876044666714240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135830.892060:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666714240:0@lo:400:kworker.0 00010000:00080000:2.0:1789135830.892069:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83840 x1876044666714752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135830.892077:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666714752:0@lo:400:kworker.0 00000100:00100000:2.0:1789135830.892109:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666713984:0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.892827:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666713472 00000100:00100000:3.0:1789135830.892835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666713472 00000100:00100000:3.0:1789135830.892907:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789135830.892915:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666713472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135830.892969:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666713472:12345-0@lo:400:kworker.0 Request processed in 55us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135830.892976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789135830.893179:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666713472:0@lo:400:kworker.0 00000100:00080000:0.0:1789135830.893256:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135831.028136:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135831.028181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135831.028231:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135831.028316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623872 00000100:00100000:1.0:1789135831.028338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623872 00000100:00100000:1.0:1789135831.028398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623744 00000100:00100000:1.0:1789135831.028402:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623744 00000100:00100000:1.0:1789135831.028425:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:1.0:1789135831.028434:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644623872:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135831.028515:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644623872:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135831.028522:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:1.0:1789135831.028556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:1.0:1789135831.028563:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644623744:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135831.028588:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644623744:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135831.028594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:2.0:1789135831.028732:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644623616 00000100:00100000:2.0:1789135831.028737:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644623616 00000100:00100000:2.0:1789135831.028782:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 285 00000100:00100000:2.0:1789135831.028790:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2390:x1876044644623616:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135831.028841:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2390:x1876044644623616:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 52us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135831.028849:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 285 00000100:00080000:0.0:1789135831.029225:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135831.029230:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789135831.272135:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135831.401121:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666714880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135831.401197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135831.401349:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666714880 00000100:00100000:3.0:1789135831.401371:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666714880 00000100:00100000:3.0:1789135831.401428:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135831.401437:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666714880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135831.401466:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135831.401520:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666714880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135831.401527:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789135831.401714:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82940 x1876044666714880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135831.401745:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666714880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135831.410720:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135831.410747:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666715008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135831.410819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135831.410962:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715008 00000100:00100000:3.0:1789135831.410970:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715008 00000100:00100000:3.0:1789135831.411015:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135831.411025:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666715008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135831.411047:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135831.411091:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666715008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135831.411098:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789135831.411176:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e81a40 x1876044666715008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135831.411194:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666715008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135831.917884:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666715136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135831.917974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135831.918092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715136 00000100:00100000:1.0:1789135831.918101:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715136 00000100:00100000:1.0:1789135831.918157:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789135831.918166:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666715136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135831.918201:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135831.918246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666715136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135831.918254:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135831.918335:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666715136:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789135832.041666:0:11315:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.127 00010000:00010000:0.0:1789135832.297790:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135833.320153:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135834.053066:0:11363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 10:10:31 EDT 2026 00010000:00010000:0.0:1789135834.344872:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135835.369419:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135835.496554:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135835.502924:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666715264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135835.503043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135835.504022:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715264 00000100:00100000:3.0:1789135835.504038:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715264 00000100:00100000:3.0:1789135835.504120:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789135835.504133:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666715264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135835.504186:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135835.505417:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666715264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1276us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135835.505436:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789135835.506139:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666715264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135836.008071:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666715392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135836.008171:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135836.008301:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715392 00000100:00100000:1.0:1789135836.008310:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715392 00000100:00100000:1.0:1789135836.008382:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789135836.008403:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666715392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135836.008445:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135836.008512:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666715392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.008521:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789135836.008546:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135836.008582:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6609a40 x1876044666715392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135836.008604:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666715392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135836.009416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666715520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135836.009481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135836.009514:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666716032:0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.009563:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135836.009573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666715648:0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.009586:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666716544:0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.009615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135836.009641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135836.009675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666716160:0@lo:400:kworker.0 00000100:00100000:2.0:1789135836.009704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135836.009722:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666716672:0@lo:400:kworker.0 00000100:00100000:2.0:1789135836.009753:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716160 00000100:00100000:2.0:1789135836.009759:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716160 00000100:00100000:2.0:1789135836.009807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789135836.009816:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666716160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135836.009893:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666716160:12345-0@lo:400:kworker.0 Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135836.009901:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135836.012113:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666715776:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.012196:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666715904:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.012243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135836.012525:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716032 00000100:00100000:3.0:1789135836.012534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716032 00000100:00100000:3.0:1789135836.012582:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716544 00000100:00100000:3.0:1789135836.012585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716544 00000100:00100000:3.0:1789135836.012617:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789135836.012626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666716032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.012811:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666716032:12345-0@lo:400:kworker.0 Request processed in 185us (3248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.012819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789135836.012842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789135836.012850:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666716544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.012976:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666716416:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.016565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135836.016797:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666716928:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.016850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135836.017797:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715520 00000100:00100000:1.0:1789135836.017810:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715520 00000100:00100000:1.0:1789135836.018428:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135836.018443:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666715520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135836.018494:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135836.018560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135836.018564:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666716544:12345-0@lo:400:kworker.0 Request processed in 5711us (8943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.018577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789135836.018606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716416 00000100:00100000:3.0:1789135836.018611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716416 00000100:00100000:3.0:1789135836.020796:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716672 00000100:00100000:3.0:1789135836.020808:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716672 00000100:00100000:3.0:1789135836.020845:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789135836.020890:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666716416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135836.022079:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666716160:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.025081:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666715520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6627us (15585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.025102:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135836.025177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135836.025195:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666716672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.025405:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666716672:12345-0@lo:400:kworker.0 Request processed in 218us (6846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.025413:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135836.025449:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715648 00000100:00100000:1.0:1789135836.025471:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715648 00000100:00100000:1.0:1789135836.025519:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789135836.025527:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666715648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.025563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666715648:12345-0@lo:400:kworker.0 Request processed in 38us (15923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.025570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789135836.025606:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715904 00000100:00100000:1.0:1789135836.025611:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715904 00000100:00100000:1.0:1789135836.025643:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789135836.025651:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666715904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.026204:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666715904:12345-0@lo:400:kworker.0 Request processed in 552us (13971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.026212:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789135836.026253:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135836.026308:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666716288:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.026344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135836.026357:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666716800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.026410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789135836.026450:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135836.026468:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135836.026472:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135836.026496:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716928 00000100:00100000:1.0:1789135836.026501:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716928 00000100:00100000:1.0:1789135836.026540:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716800 00000100:00100000:1.0:1789135836.026543:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716800 00000100:00100000:1.0:1789135836.026565:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789135836.026572:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666716928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.032250:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666716416:12345-0@lo:400:kworker.0 Request processed in 11371us (15674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.032270:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789135836.032323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666715776 00000100:00100000:3.0:1789135836.032341:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666715776 00000100:00100000:3.0:1789135836.032379:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666716288 00000100:00100000:3.0:1789135836.032382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666716288 00000100:00100000:3.0:1789135836.032405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135836.032414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666715776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.032531:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666715776:12345-0@lo:400:kworker.0 Request processed in 118us (6278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.032537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135836.032548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789135836.032554:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666716288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.032579:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666716288:12345-0@lo:400:kworker.0 Request processed in 26us (6235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.032585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789135836.032647:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666716544:0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.032664:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666716032:0@lo:400:kworker.0 00010000:00080000:3.0:1789135836.032680:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e830c0 x1876044666715520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135836.032886:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666715520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135836.032977:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666715904:0@lo:400:kworker.0 00010000:00080000:3.0:1789135836.032992:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3c3c0 x1876044666716416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135836.033001:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666716416:0@lo:400:kworker.0 00000100:00100000:0.0:1789135836.033069:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666715776:0@lo:400:kworker.0 00000100:00100000:0.0:1789135836.033082:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666716288:0@lo:400:kworker.0 00000100:00100000:0.0:1789135836.034098:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789135836.034114:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666716800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135836.034197:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666716800:12345-0@lo:400:kworker.0 Request processed in 90us (7787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135836.034216:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789135836.034263:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135836.034269:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135836.034308:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3f840 x1876044666716800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135836.034322:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666716800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.034535:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666716928:12345-0@lo:400:kworker.0 Request processed in 7961us (17682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.034544:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1789135836.035410:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3d680 x1876044666716928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135836.035442:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666716928:0@lo:400:kworker.0 00000100:00100000:3.0:1789135836.035516:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ec1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666715648:0@lo:400:kworker.0 00010000:00080000:3.0:1789135836.035531:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3cb40 x1876044666716672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135836.035541:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666716672:0@lo:400:kworker.0 00000100:00100000:1.0:1789135836.145813:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135836.146043:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135836.146083:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135836.146262:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624256 00000100:00100000:2.0:1789135836.146274:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624256 00000100:00100000:2.0:1789135836.146369:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624128 00000100:00100000:2.0:1789135836.146372:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624128 00000100:00100000:2.0:1789135836.146415:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:2.0:1789135836.146426:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644624256:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135836.146537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644624256:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135836.146546:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:2.0:1789135836.146567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:2.0:1789135836.146574:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644624128:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135836.146598:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644624128:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135836.146604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00080000:1.0:1789135836.146898:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135836.146904:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135836.147178:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624000 00000100:00100000:3.0:1789135836.147184:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624000 00000100:00100000:3.0:1789135836.147299:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 287 00000100:00100000:3.0:1789135836.147308:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2389:x1876044644624000:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135836.147388:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2389:x1876044644624000:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 81us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.147396:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 287 00010000:00010000:0.0:1789135836.392310:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135836.520547:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666717056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135836.520656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135836.522545:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717056 00000100:00100000:1.0:1789135836.522566:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717056 00000100:00100000:1.0:1789135836.522643:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135836.522656:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666717056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135836.522710:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135836.522825:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666717056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135836.522834:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789135836.522929:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ceb840 x1876044666717056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135836.522953:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666717056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135836.527174:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666717184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135836.527275:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135836.527389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717184 00000100:00100000:3.0:1789135836.527397:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717184 00000100:00100000:3.0:1789135836.527472:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789135836.527484:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666717184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135836.527517:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135836.527570:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666717184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135836.527579:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789135836.527627:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e830c0 x1876044666717184/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135836.527664:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666717184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135837.033338:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666717312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135837.033450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135837.033553:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717312 00000100:00100000:3.0:1789135837.033562:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717312 00000100:00100000:3.0:1789135837.033625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135837.033636:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666717312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135837.033685:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135837.033739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666717312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135837.033747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135837.033821:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666717312:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789135837.416238:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135838.440373:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135839.464034:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135840.488976:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135840.618547:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135840.618572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666717440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135840.619082:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135840.620003:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717440 00000100:00100000:1.0:1789135840.620013:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717440 00000100:00100000:1.0:1789135840.620078:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789135840.620087:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666717440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135840.620138:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135840.620200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666717440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135840.620207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789135840.620623:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666717440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135841.129897:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135841.140223:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666717696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135841.140308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.140396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666717568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135841.140422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.140452:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135841.140459:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666718080:0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.140485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.140535:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666717824:0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.140564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.140609:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135841.140616:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666717952:0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.140639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.140668:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717696 00000100:00100000:0.0:1789135841.140676:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717696 00000100:00100000:0.0:1789135841.140722:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717568 00000100:00100000:0.0:1789135841.140725:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717568 00000100:00100000:0.0:1789135841.140745:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135841.140752:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666717696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135841.140783:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135841.140836:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666717696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.140844:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789135841.140880:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135841.140887:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666717568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135841.140896:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135841.140920:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666717568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.140926:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789135841.140947:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718080 00000100:00100000:0.0:1789135841.140950:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718080 00000100:00100000:0.0:1789135841.140976:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789135841.140983:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666718080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.141016:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666718080:12345-0@lo:400:kworker.0 Request processed in 34us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.141022:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789135841.141040:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717952 00000100:00100000:0.0:1789135841.141049:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717952 00000100:00100000:0.0:1789135841.141078:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789135841.141084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666717952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.141118:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666717952:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.141124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1789135841.141141:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135841.141176:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666717952:0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.141204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666718080:0@lo:400:kworker.0 00010000:00080000:0.0:1789135841.141218:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3cea1c0 x1876044666717696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135841.141233:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666717696:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789135841.141243:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3f480 x1876044666717568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135841.141254:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666717568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135841.151727:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666718464:0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.151803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135841.151845:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666718976:0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.151888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135841.151891:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666718336:0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.151923:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666718592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.151923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135841.151942:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666718848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.151959:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135841.151972:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666717824 00000100:00100000:1.0:1789135841.151989:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718336 00000100:00100000:1.0:1789135841.151993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718336 00000100:00100000:1.0:1789135841.152039:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789135841.152048:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666718336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.152106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666718336:12345-0@lo:400:kworker.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135841.152114:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789135841.152114:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666718208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.152137:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718464 00000100:00100000:1.0:1789135841.152140:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718464 00000100:00100000:0.0:1789135841.152144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.152162:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666718720:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.152168:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718848 00000100:00100000:1.0:1789135841.152171:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718848 00000100:00100000:0.0:1789135841.152181:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135841.152183:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718208 00000100:00100000:1.0:1789135841.152185:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718208 00000100:00100000:1.0:1789135841.152195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718720 00000100:00100000:1.0:1789135841.152197:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718720 00000100:00100000:0.0:1789135841.152205:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789135841.152212:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666718464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.152247:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666718464:12345-0@lo:400:kworker.0 Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135841.152285:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666717824 00000100:00100000:3.0:1789135841.152315:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789135841.152321:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666717824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.152357:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666717824:12345-0@lo:400:kworker.0 Request processed in 36us (11791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135841.152386:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789135841.152418:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718976 00000100:00100000:3.0:1789135841.152422:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718976 00000100:00100000:3.0:1789135841.152450:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789135841.152456:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666718976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.152487:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666718976:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135841.152493:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789135841.152510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135841.152522:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666719104:0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.152543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135841.152586:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666718464:0@lo:400:kworker.0 00010000:00080000:3.0:1789135841.152599:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c96d21c0 x1876044666718976/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135841.152610:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666718976:0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.152635:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719104 00000100:00100000:3.0:1789135841.152639:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719104 00000100:00100000:3.0:1789135841.152666:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789135841.152672:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666719104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135841.152704:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666719104:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135841.152711:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789135841.152739:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c23121c0 x1876044666719104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135841.152748:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666719104:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158039:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666718592 00000100:00100000:1.0:1789135841.158054:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666718592 00000100:00100000:1.0:1789135841.158103:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789135841.158115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666718848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158216:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666718848:12345-0@lo:400:kworker.0 Request processed in 104us (6255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135841.158224:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789135841.158246:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789135841.158253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666718208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666718208:12345-0@lo:400:kworker.0 Request processed in 48us (6155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135841.158306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789135841.158319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135841.158325:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666718720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158354:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666718720:12345-0@lo:400:kworker.0 Request processed in 30us (6172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135841.158373:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135841.158386:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789135841.158392:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666718592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158442:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666718592:12345-0@lo:400:kworker.0 Request processed in 50us (5931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135841.158449:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1789135841.158496:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83840 x1876044666718592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135841.158511:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666718592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158546:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666718336:0@lo:400:kworker.0 00010000:00080000:1.0:1789135841.158558:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e940 x1876044666718848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135841.158580:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666718848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158594:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666717824:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158632:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666718208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135841.158643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666718720:0@lo:400:kworker.0 00000100:00100000:0.0:1789135841.160874:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789135841.161057:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135841.161064:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135841.161067:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135841.267634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135841.267687:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135841.267726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135841.267846:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624384 00000100:00100000:3.0:1789135841.267874:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624384 00000100:00100000:3.0:1789135841.267936:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 289 00000100:00100000:3.0:1789135841.267948:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644624384:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135841.268024:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644624384:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 78us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135841.268031:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 289 00000100:00100000:0.0:1789135841.268775:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624640 00000100:00100000:0.0:1789135841.268783:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624640 00000100:00100000:0.0:1789135841.268834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624512 00000100:00100000:0.0:1789135841.268838:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624512 00000100:00100000:0.0:1789135841.268881:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1789135841.268890:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644624640:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135841.268944:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644624640:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 55us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.268951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1789135841.268967:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:0.0:1789135841.268974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644624512:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135841.269001:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644624512:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.269007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00080000:1.0:1789135841.269089:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135841.269095:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789135841.512047:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135841.641684:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135841.641708:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666719232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135841.641780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.643072:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719232 00000100:00100000:0.0:1789135841.643083:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719232 00000100:00100000:0.0:1789135841.643140:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789135841.643150:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666719232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135841.643184:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135841.643256:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666719232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.643263:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789135841.643573:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e940 x1876044666719232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135841.643596:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666719232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135841.648459:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666719360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135841.648536:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135841.648607:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719360 00000100:00100000:0.0:1789135841.648614:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719360 00000100:00100000:0.0:1789135841.648663:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789135841.648673:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666719360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135841.648700:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135841.648745:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666719360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135841.648752:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789135841.648794:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe21c0 x1876044666719360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135841.648815:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666719360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135842.153358:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666719488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135842.153448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135842.154680:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719488 00000100:00100000:2.0:1789135842.154691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719488 00000100:00100000:2.0:1789135842.154748:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789135842.154757:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666719488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135842.154793:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135842.154879:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666719488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135842.154888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789135842.155651:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666719488:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135842.536018:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135843.564244:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135844.585204:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135845.609113:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135845.736573:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135845.736606:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666719616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135845.737184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135845.737361:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719616 00000100:00100000:1.0:1789135845.737374:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719616 00000100:00100000:1.0:1789135845.737484:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789135845.737498:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666719616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135845.737558:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135845.737621:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666719616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135845.737630:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789135845.737723:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666719616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135846.248495:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135846.248528:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666719744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135846.248626:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135846.248732:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719744 00000100:00100000:0.0:1789135846.248742:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719744 00000100:00100000:0.0:1789135846.248814:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135846.248826:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666719744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135846.248888:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135846.248942:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666719744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135846.248961:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1789135846.249034:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe3840 x1876044666719744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135846.249057:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666719744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789135846.249350:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135846.249360:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135846.249371:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666719872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135846.249405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135846.249434:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666719872 00000100:00100000:1.0:1789135846.249438:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666719872 00000100:00100000:1.0:1789135846.249472:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135846.249480:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666719872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135846.249492:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135846.249522:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666719872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135846.249528:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789135846.249544:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135846.249559:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a7c00 x1876044666719872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135846.249573:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666719872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135846.255571:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666720256:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.255674:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.255741:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666720768:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.255774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.255799:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666721280:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.255829:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.255889:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789135846.255896:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666720128:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.255922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.255938:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666720640:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.255961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.255975:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666721152:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.255996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.256034:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721280 00000100:00100000:3.0:1789135846.256051:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721280 00000100:00100000:3.0:1789135846.256129:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721152 00000100:00100000:3.0:1789135846.256132:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721152 00000100:00100000:3.0:1789135846.256159:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135846.256169:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666721280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256233:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666721280:12345-0@lo:400:kworker.0 Request processed in 66us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.256242:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789135846.256261:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789135846.256278:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666721152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256319:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666721152:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.256326:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789135846.256358:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666720000:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256392:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.256415:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666720512:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.256456:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666721024:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.256499:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789135846.256506:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666720384:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256530:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.256542:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666720896:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256568:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.256593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720000 00000100:00100000:3.0:1789135846.256596:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720000 00000100:00100000:3.0:1789135846.256633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789135846.256640:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666720000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256677:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666720000:12345-0@lo:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.256684:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789135846.256714:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720256 00000100:00100000:3.0:1789135846.256718:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720256 00000100:00100000:3.0:1789135846.256742:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720512 00000100:00100000:3.0:1789135846.256745:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720512 00000100:00100000:3.0:1789135846.256761:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789135846.256768:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666720256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256802:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666720256:12345-0@lo:400:kworker.0 Request processed in 35us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.256808:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789135846.256818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789135846.256825:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666720512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.256880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666720512:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.256887:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789135846.256904:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720768 00000100:00100000:3.0:1789135846.256908:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720768 00000100:00100000:3.0:1789135846.256932:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720128 00000100:00100000:3.0:1789135846.256935:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720128 00000100:00100000:3.0:1789135846.256944:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720640 00000100:00100000:3.0:1789135846.256947:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720640 00000100:00100000:3.0:1789135846.256959:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721024 00000100:00100000:3.0:1789135846.256962:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721024 00000100:00100000:3.0:1789135846.256978:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720384 00000100:00100000:3.0:1789135846.256981:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720384 00000100:00100000:3.0:1789135846.257005:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666720896 00000100:00100000:3.0:1789135846.257009:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666720896 00000100:00100000:3.0:1789135846.257027:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789135846.257034:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666720768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257066:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666720768:12345-0@lo:400:kworker.0 Request processed in 33us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.257073:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789135846.257086:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789135846.257093:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666720128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257124:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666720128:12345-0@lo:400:kworker.0 Request processed in 32us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.257131:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789135846.257144:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789135846.257152:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666720640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257202:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666720640:12345-0@lo:400:kworker.0 Request processed in 49us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.257209:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789135846.257222:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789135846.257228:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666721024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257254:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666721024:12345-0@lo:400:kworker.0 Request processed in 28us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.257261:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789135846.257290:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789135846.257295:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666720384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257319:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666720384:12345-0@lo:400:kworker.0 Request processed in 25us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.257332:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789135846.257344:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789135846.257349:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666720896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257376:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666720896:12345-0@lo:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.257382:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789135846.257431:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666720384:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257443:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666720896:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257453:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6629e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666720000:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257464:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666720512:0@lo:400:kworker.0 00010000:00080000:3.0:1789135846.257478:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ede00 x1876044666721024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.257488:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666721024:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257534:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666720128:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257546:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666720640:0@lo:400:kworker.0 00010000:00080000:3.0:1789135846.257559:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ecf00 x1876044666721152/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.257570:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666721152:0@lo:400:kworker.0 00000100:00100000:3.0:1789135846.257581:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666720256:0@lo:400:kworker.0 00010000:00080000:3.0:1789135846.257590:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ecb40 x1876044666720768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.257607:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666720768:0@lo:400:kworker.0 00010000:00080000:3.0:1789135846.257621:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ef0c0 x1876044666721280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.257630:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666721280:0@lo:400:kworker.0 00000100:00080000:1.0:1789135846.258000:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135846.258006:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135846.258009:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135846.385526:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135846.385579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135846.385626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135846.385807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625024 00000100:00100000:3.0:1789135846.385808:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624768 00000100:00100000:3.0:1789135846.385820:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624768 00000100:00100000:0.0:1789135846.385820:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625024 00000100:00080000:1.0:1789135846.385890:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135846.385921:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644624896 00000100:00100000:1.0:1789135846.385925:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644624896 00000100:00100000:0.0:1789135846.385932:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:0.0:1789135846.385944:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644625024:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135846.385960:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:1.0:1789135846.385966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644624896:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135846.386047:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644624896:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 80us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135846.386074:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00080000:1.0:1789135846.386101:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135846.386205:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 291 00000100:00100000:3.0:1789135846.386214:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644624768:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135846.389681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644625024:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 3719us (4082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135846.389701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:3.0:1789135846.394735:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644624768:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 8501us (9203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.394754:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 291 00010000:00010000:0.0:1789135846.632972:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135846.765180:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135846.765221:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666721408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135846.765343:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135846.765622:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721408 00000100:00100000:0.0:1789135846.765632:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721408 00000100:00100000:0.0:1789135846.765695:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789135846.765706:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666721408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135846.765748:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135846.765803:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666721408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135846.765811:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1789135846.766036:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe3840 x1876044666721408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.766061:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666721408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135846.774640:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135846.774672:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666721536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135846.774770:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135846.775080:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721536 00000100:00100000:3.0:1789135846.775091:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721536 00000100:00100000:3.0:1789135846.775159:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789135846.775180:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666721536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135846.775212:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135846.775508:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666721536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 338us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135846.775532:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789135846.775583:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662a1c0 x1876044666721536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135862 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135846.775607:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666721536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135847.279055:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666721664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135847.279156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135847.279368:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721664 00000100:00100000:2.0:1789135847.279378:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721664 00000100:00100000:2.0:1789135847.279447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789135847.279459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666721664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135847.279506:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135847.279562:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666721664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135847.279737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666721664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135847.280683:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:1.0:1789135847.657312:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135848.680075:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135849.705529:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135850.729312:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135850.864993:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135850.865016:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666721792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135850.865089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135850.865161:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721792 00000100:00100000:1.0:1789135850.865168:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721792 00000100:00100000:1.0:1789135850.865225:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789135850.865234:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666721792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135850.865270:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135850.865317:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666721792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135850.865324:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789135850.865383:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666721792:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789135851.199495:0:11992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:10:48 (1789135848) === 00000100:00100000:1.0:1789135851.369240:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666721920:0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.369312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135851.369364:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666722432:0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.369388:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135851.369405:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666722944:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.369919:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666722176:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.369966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.369987:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666722688:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370027:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666723200:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370082:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789135851.370089:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666722304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370108:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370123:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666722816:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370184:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666723328:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370227:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666723712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135851.370251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135851.370274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370279:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666722048:0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.370292:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666723456:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135851.370311:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.370316:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666722560:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135851.370343:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666721920 00000100:00100000:1.0:1789135851.370350:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666721920 00000100:00100000:1.0:1789135851.370394:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789135851.370404:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666721920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.370653:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666721920:12345-0@lo:400:kworker.0 Request processed in 249us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135851.370661:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789135851.370693:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722432 00000100:00100000:1.0:1789135851.370698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722432 00000100:00100000:1.0:1789135851.370794:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722176 00000100:00100000:1.0:1789135851.370798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722176 00000100:00100000:1.0:1789135851.370815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789135851.370821:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666722432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.370874:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666722432:12345-0@lo:400:kworker.0 Request processed in 53us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135851.370880:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789135851.370881:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666723072:0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.370893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789135851.370899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c6e45c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666722176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.370918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135851.370929:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c6e45c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666722176:12345-0@lo:400:kworker.0 Request processed in 31us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135851.370931:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666723584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135851.370935:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789135851.370962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135851.371008:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722688 00000100:00100000:0.0:1789135851.371011:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722688 00000100:00100000:0.0:1789135851.371037:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723200 00000100:00100000:0.0:1789135851.371040:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723200 00000100:00100000:0.0:1789135851.371050:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722304 00000100:00100000:0.0:1789135851.371052:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722304 00000100:00100000:0.0:1789135851.371060:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722048 00000100:00100000:0.0:1789135851.371062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722048 00000100:00100000:0.0:1789135851.371078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722560 00000100:00100000:0.0:1789135851.371080:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722560 00000100:00100000:0.0:1789135851.371090:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723072 00000100:00100000:0.0:1789135851.371092:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723072 00000100:00100000:0.0:1789135851.371103:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789135851.371107:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666722688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.371136:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666722688:12345-0@lo:400:kworker.0 Request processed in 29us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135851.371142:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789135851.371153:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789135851.371158:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666723200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.371196:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666723200:12345-0@lo:400:kworker.0 Request processed in 37us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135851.371202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789135851.371209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789135851.371213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789135851.371216:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666722304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.371217:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666722048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.371249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666722304:12345-0@lo:400:kworker.0 Request processed in 33us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135851.371249:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666722048:12345-0@lo:400:kworker.0 Request processed in 30us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135851.371255:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789135851.371361:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722816 00000100:00100000:3.0:1789135851.371365:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722816 00000100:00100000:3.0:1789135851.371493:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723328 00000100:00100000:3.0:1789135851.371497:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723328 00000100:00100000:3.0:1789135851.371510:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666722944 00000100:00100000:3.0:1789135851.371513:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666722944 00000100:00100000:3.0:1789135851.371525:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723456 00000100:00100000:3.0:1789135851.371527:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723456 00000100:00100000:3.0:1789135851.371554:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135851.371562:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666722816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135851.371599:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666722816:12345-0@lo:400:kworker.0 Request processed in 39us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.371605:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135851.371617:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135851.371623:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666723328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135851.371648:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666723328:12345-0@lo:400:kworker.0 Request processed in 26us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.371654:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135851.371665:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135851.371670:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666722944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135851.371695:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666722944:12345-0@lo:400:kworker.0 Request processed in 25us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.371710:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135851.371733:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789135851.371739:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666723456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135851.371767:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666723456:12345-0@lo:400:kworker.0 Request processed in 29us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.371773:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789135851.372698:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789135851.372934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135851.372946:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666722560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.372999:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666722560:12345-0@lo:400:kworker.0 Request processed in 58us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135851.373006:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135851.373020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789135851.373027:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666723072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.373053:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666723072:12345-0@lo:400:kworker.0 Request processed in 28us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135851.373058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789135851.373082:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723712 00000100:00100000:1.0:1789135851.373087:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723712 00000100:00100000:1.0:1789135851.373158:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723584 00000100:00100000:1.0:1789135851.373162:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723584 00000100:00100000:0.0:1789135851.373624:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666722048:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.373638:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666722560:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.373648:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666723072:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.375098:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666721920:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.375118:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666722432:0@lo:400:kworker.0 00010000:00080000:0.0:1789135851.375152:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f85a40 x1876044666722944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135851.375163:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666722944:0@lo:400:kworker.0 00010000:00080000:0.0:1789135851.375191:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44652c0 x1876044666723456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135851.375200:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666723456:0@lo:400:kworker.0 00000100:00100000:3.0:1789135851.382559:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135851.382580:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666723712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135851.382617:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135851.382696:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666723712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (12444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.382703:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135851.382738:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789135851.382745:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666723584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135851.382755:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135851.382795:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666723584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (11832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.382801:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789135851.388546:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe12c0 x1876044666723584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135851.388577:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666723584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789135851.391124:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135851.391134:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135851.391138:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135851.391141:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789135851.397057:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662a1c0 x1876044666723712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.397086:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666723712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135851.397107:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666722304:0@lo:400:kworker.0 00010000:00080000:1.0:1789135851.397119:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f84f00 x1876044666722816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.397134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666722816:0@lo:400:kworker.0 00010000:00080000:1.0:1789135851.397146:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f84000 x1876044666723328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.397154:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666723328:0@lo:400:kworker.0 00000100:00100000:1.0:1789135851.397163:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666722176:0@lo:400:kworker.0 00010000:00080000:1.0:1789135851.397184:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f87c00 x1876044666722688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.397193:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666722688:0@lo:400:kworker.0 00010000:00080000:1.0:1789135851.397206:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f87840 x1876044666723200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.397213:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666723200:0@lo:400:kworker.0 00000100:00100000:0.0:1789135851.516916:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135851.516954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135851.516983:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135851.517050:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625152 00000100:00100000:3.0:1789135851.517060:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625152 00000100:00100000:3.0:1789135851.517120:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 293 00000100:00100000:3.0:1789135851.517130:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2390:x1876044644625152:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135851.517208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2390:x1876044644625152:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 79us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.517232:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 293 00000100:00100000:2.0:1789135851.517900:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625408 00000100:00100000:2.0:1789135851.517905:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625408 00000100:00100000:2.0:1789135851.518062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625280 00000100:00100000:2.0:1789135851.518066:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625280 00000100:00100000:2.0:1789135851.518296:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:2.0:1789135851.518306:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644625408:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135851.518378:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644625408:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 73us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135851.518385:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:2.0:1789135851.518400:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:2.0:1789135851.518430:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644625280:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135851.518458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644625280:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135851.518464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00080000:2.0:1789135851.525660:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135851.525671:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789135851.752325:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135851.882802:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666723840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135851.882918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135851.884538:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723840 00000100:00100000:3.0:1789135851.884548:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723840 00000100:00100000:3.0:1789135851.884616:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789135851.884628:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666723840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135851.884657:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135851.884722:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666723840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.884729:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789135851.888425:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135851.888458:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666723968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135851.888533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135851.888698:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662b840 x1876044666723840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135851.888734:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666723840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135851.889542:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666723968 00000100:00100000:3.0:1789135851.889550:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666723968 00000100:00100000:3.0:1789135851.889606:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789135851.889616:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666723968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135851.889639:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135851.889702:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666723968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135851.889708:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1789135851.889793:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ff4f00 x1876044666723968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135851.889810:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666723968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135852.394580:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666724096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135852.394689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135852.397513:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724096 00000100:00100000:3.0:1789135852.397528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724096 00000100:00100000:3.0:1789135852.397614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789135852.397623:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666724096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135852.397658:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135852.397742:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666724096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (3053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.397749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789135852.398264:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666724096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135852.460526:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135852.460902:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625536 00000100:00100000:3.0:1789135852.461122:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625536 00000100:00100000:3.0:1789135852.461207:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 294 00000100:00100000:3.0:1789135852.461218:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+10:8724:x1876044644625536:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789135852.461241:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135852.461263:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de2aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08849 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135852.461300:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de2aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08849 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135852.461315:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de2aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08849 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135852.461338:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e200, rc 0) 00000100:00100000:3.0:1789135852.461813:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+11:8724:x1876044644625536:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 595us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.461823:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 294 00000100:00100000:0.0:1789135852.464571:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.464739:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625664 00000100:00100000:1.0:1789135852.464751:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625664 00000100:00100000:1.0:1789135852.464813:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 295 00000100:00100000:1.0:1789135852.464824:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:8724:x1876044644625664:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789135852.466590:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:8724:x1876044644625664:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 1759us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135852.466605:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 295 00000100:00100000:1.0:1789135852.485215:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.485352:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625792 00000100:00100000:0.0:1789135852.485366:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625792 00000100:00100000:0.0:1789135852.485683:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 296 00000100:00100000:0.0:1789135852.485697:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+11:8724:x1876044644625792:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789135852.486091:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+11:8724:x1876044644625792:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 397us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.486101:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 296 00000100:00100000:0.0:1789135852.503971:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135852.504668:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644625920 00000100:00100000:3.0:1789135852.504682:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644625920 00000100:00100000:3.0:1789135852.504758:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 297 00000100:00100000:3.0:1789135852.504769:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+11:8728:x1876044644625920:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135852.505164:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+11:8728:x1876044644625920:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 387us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.505174:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 297 00000100:00100000:3.0:1789135852.591054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.596969:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626048 00000100:00100000:1.0:1789135852.596997:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626048 00000100:00100000:1.0:1789135852.597118:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 298 00000100:00100000:1.0:1789135852.597131:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:8728:x1876044644626048:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135852.597537:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:8728:x1876044644626048:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 407us (6509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135852.597546:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 298 00000100:00100000:1.0:1789135852.622229:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.622790:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626176 00000100:00100000:0.0:1789135852.622804:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626176 00000100:00100000:0.0:1789135852.622928:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 299 00000100:00100000:0.0:1789135852.622941:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+11:8728:x1876044644626176:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135852.623199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+11:8728:x1876044644626176:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 260us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.623229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 299 00000100:00100000:0.0:1789135852.631472:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135852.636079:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626304 00000100:00100000:3.0:1789135852.636099:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626304 00000100:00100000:2.0:1789135852.641366:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 300 00000100:00100000:2.0:1789135852.641410:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+11:8724:x1876044644626304:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789135852.641443:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135852.641474:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94c800/0x559c8745c6de2ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0887a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135852.641526:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94c800/0x559c8745c6de2ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0887a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135852.641563:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94c800/0x559c8745c6de2ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0887a expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135852.641595:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94c800, rc 0) 00000100:00100000:2.0:1789135852.643917:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:8724:x1876044644626304:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 2523us (12516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135852.643945:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 300 00000100:00100000:3.0:1789135852.649579:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.657599:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626432 00000100:00100000:0.0:1789135852.660644:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626432 00000100:00100000:0.0:1789135852.660759:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 301 00000100:00100000:0.0:1789135852.660777:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:8724:x1876044644626432:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789135852.660816:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789135852.660887:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789135852.660892:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789135852.660896:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789135852.660900:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789135852.660902:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789135852.665741:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:8724:x1876044644626432:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 4954us (16160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.665759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 301 00000100:00100000:0.0:1789135852.669308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.674381:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626560 00000100:00100000:1.0:1789135852.674430:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626560 00000100:00100000:2.0:1789135852.677805:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 302 00000100:00100000:2.0:1789135852.677840:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:8724:x1876044644626560:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789135852.677880:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135852.677907:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08881 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135852.678058:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135852.678072:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135852.678083:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94d000, rc 0) 00000100:00100000:2.0:1789135852.678200:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:8724:x1876044644626560:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 378us (8903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135852.678208:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 302 00000100:00100000:3.0:1789135852.690218:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.690433:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626688 00000100:00100000:0.0:1789135852.690445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626688 00000100:00100000:0.0:1789135852.690520:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 303 00000100:00100000:0.0:1789135852.690532:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:8724:x1876044644626688:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789135852.690849:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:8724:x1876044644626688:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 317us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.690908:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 303 00000100:00100000:3.0:1789135852.693378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.693718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626816 00000100:00100000:0.0:1789135852.693731:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626816 00000100:00100000:0.0:1789135852.693799:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 304 00000100:00100000:0.0:1789135852.693828:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:8724:x1876044644626816:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789135852.694057:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:8724:x1876044644626816:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 230us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.694066:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 304 00000100:00100000:1.0:1789135852.711712:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135852.711896:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644626944 00000100:00100000:3.0:1789135852.711911:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644626944 00000100:00100000:3.0:1789135852.711993:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 305 00000100:00100000:3.0:1789135852.712003:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:8732:x1876044644626944:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135852.712231:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:8732:x1876044644626944:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 228us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.712240:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 305 00000100:00100000:1.0:1789135852.716192:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135852.727724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627072 00000100:00100000:2.0:1789135852.727745:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627072 00000100:00100000:2.0:1789135852.727846:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 306 00000100:00100000:2.0:1789135852.727876:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:8732:x1876044644627072:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135852.728121:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:8732:x1876044644627072:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 264us (11943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135852.728139:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 306 00000100:00100000:1.0:1789135852.732076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.732123:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.732182:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.732290:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.745604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627200 00000100:00100000:0.0:1789135852.745626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627200 00000100:00100000:0.0:1789135852.745696:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627456 00000100:00100000:0.0:1789135852.745700:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627456 00000100:00100000:0.0:1789135852.745711:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627840 00000100:00100000:0.0:1789135852.745714:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627840 00000100:00100000:0.0:1789135852.745749:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627968 00000100:00100000:0.0:1789135852.745752:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627968 00000100:00100000:0.0:1789135852.745778:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:0.0:1789135852.745791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644627840:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135852.745993:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644627840:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 203us (13807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.746002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:0.0:1789135852.746027:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:0.0:1789135852.746036:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644627968:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135852.746066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644627968:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (13775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.746073:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:0.0:1789135852.746087:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789135852.746092:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4466d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876044644627200:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789135852.746121:0:6516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from f8cf048c-d8c6-435a-a255-87c185db70f0@192.168.201.31@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1789135852.746207:0:6516:0:(genops.c:1385:class_connect()) connect: client f8cf048c-d8c6-435a-a255-87c185db70f0, cookie 0x559c8745c6de2abe 00000004:00100000:0.0:1789135852.746241:0:6516:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789135852.747549:0:6516:0:(import.c:65:import_set_state_nolock()) ffff90a7ff5c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135852.747612:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4466d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2388:x1876044644627200:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 1515us (15552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.747635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789135852.747669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1789135852.747675:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876044644627456:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789135852.747696:0:6516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from f8cf048c-d8c6-435a-a255-87c185db70f0@192.168.201.31@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1789135852.747740:0:6516:0:(genops.c:1385:class_connect()) connect: client f8cf048c-d8c6-435a-a255-87c185db70f0, cookie 0x559c8745c6de2ac5 00000004:00100000:0.0:1789135852.747760:0:6516:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789135852.747873:0:6516:0:(import.c:65:import_set_state_nolock()) ffff90a7ff5c4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789135852.747900:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2388:x1876044644627456:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 223us (15776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.747907:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1789135852.752098:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.764261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135852.768037:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627328 00000100:00100000:2.0:1789135852.768057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627328 00000100:00100000:1.0:1789135852.768901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135852.769047:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627712 00000100:00100000:2.0:1789135852.769053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627712 00000100:00100000:2.0:1789135852.769129:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644627584 00000100:00100000:2.0:1789135852.769133:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644627584 00000100:00100000:2.0:1789135852.769166:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789135852.769179:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+7:8724:x1876044644627712:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789135852.769231:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789135852.769336:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+7:8724:x1876044644627712:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 161us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135852.769346:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789135852.769368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1789135852.769375:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:0:x1876044644627584:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789135852.769394:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135852.772798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:0:x1876044644627584:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 3407us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135852.772815:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00080000:1.0:1789135852.775001:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135852.775015:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135852.776468:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135852.780089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789135852.780108:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:0:x1876044644627328:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789135852.780164:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135852.780263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:0:x1876044644627328:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 158us (28180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.780271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:1.0:1789135852.780491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135852.781306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628096 00000100:00100000:3.0:1789135852.781318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628096 00000100:00100000:3.0:1789135852.781372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:3.0:1789135852.781382:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4467c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:8724:x1876044644628096:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789135852.781475:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4467c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:8724:x1876044644628096:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 95us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.781483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:1.0:1789135852.795335:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135852.795414:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.795603:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628480 00000100:00100000:0.0:1789135852.795617:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628480 00000100:00100000:0.0:1789135852.795700:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:0.0:1789135852.795713:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:8724:x1876044644628480:12345-192.168.201.31@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789135852.795820:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:8724:x1876044644628480:12345-192.168.201.31@tcp:900:mount.lustre.0 Request processed in 109us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135852.795829:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1789135852.798475:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628224 00000100:00100000:3.0:1789135852.798493:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628224 00000100:00100000:3.0:1789135852.798554:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789135852.798582:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1876044644628224:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789135852.798630:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from f8cf048c-d8c6-435a-a255-87c185db70f0@192.168.201.31@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:3.0:1789135852.798673:0:8432:0:(genops.c:1385:class_connect()) connect: client f8cf048c-d8c6-435a-a255-87c185db70f0, cookie 0x559c8745c6de2acc 00002000:00100000:3.0:1789135852.798691:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f8cf048c-d8c6-435a-a255-87c185db70f0/ffff90a7ff592800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789135852.798704:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789135852.798806:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789135852.798846:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a7ff593000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135852.799302:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2388:x1876044644628224:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 720us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.799313:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789135852.804144:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135852.804654:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135852.806716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628608 00000100:00100000:2.0:1789135852.806737:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628608 00000100:00100000:2.0:1789135852.806842:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:2.0:1789135852.806891:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:8724:x1876044644628608:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789135852.807028:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789135852.807160:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:8724:x1876044644628608:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 298us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135852.807186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:3.0:1789135852.815145:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628352 00000100:00100000:3.0:1789135852.815177:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628352 00000100:00100000:3.0:1789135852.815255:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:3.0:1789135852.815268:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644628352:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789135852.815317:0:8536:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from f8cf048c-d8c6-435a-a255-87c185db70f0@192.168.201.31@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:3.0:1789135852.815359:0:8536:0:(genops.c:1385:class_connect()) connect: client f8cf048c-d8c6-435a-a255-87c185db70f0, cookie 0x559c8745c6de2ad3 00002000:00100000:3.0:1789135852.815376:0:8536:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f8cf048c-d8c6-435a-a255-87c185db70f0/ffff90a7ff597000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789135852.815500:0:8536:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789135852.815608:0:8536:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789135852.815725:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a7ff590000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135852.815826:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2388:x1876044644628352:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 558us (11697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135852.815834:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00010000:00010000:1.0:1789135853.800716:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135854.824541:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135855.849023:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135855.985256:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666724224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135855.985322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135855.985393:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724224 00000100:00100000:1.0:1789135855.985400:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724224 00000100:00100000:1.0:1789135855.985439:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135855.985447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4467840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666724224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135855.985479:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135855.985518:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4467840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666724224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135855.985525:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135855.985562:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666724224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135856.492225:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666724352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135856.492311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135856.492489:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724352 00000100:00100000:2.0:1789135856.492497:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724352 00000100:00100000:2.0:1789135856.492552:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789135856.492563:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666724352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135856.492592:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135856.492632:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666724352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.492639:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789135856.492688:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135856.492718:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3e580 x1876044666724352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135856.492735:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666724352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135856.495810:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666724608:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.495919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.495964:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666725120:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.495985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.496007:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6411e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666725632:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.496255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.496300:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789135856.496307:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666724480:0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.496407:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725632 00000100:00100000:2.0:1789135856.496414:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725632 00000100:00100000:2.0:1789135856.496475:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135856.496487:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666725632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.496536:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666725632:12345-0@lo:400:kworker.0 Request processed in 52us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.496543:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789135856.496606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.496641:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666724992:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.496666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.496697:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666725504:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.496719:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135856.496748:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6411e00 x1876044666725632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135856.496763:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6411e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666725632:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.496790:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666724736:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.496813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135856.496826:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666725248:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.496846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135856.496953:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724480 00000100:00100000:2.0:1789135856.496958:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724480 00000100:00100000:2.0:1789135856.496987:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789135856.496994:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666724480:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789135856.497120:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135856.497631:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724608 00000100:00100000:0.0:1789135856.497636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724608 00000100:00100000:0.0:1789135856.497658:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725120 00000100:00100000:0.0:1789135856.497660:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725120 00000100:00100000:0.0:1789135856.497677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724992 00000100:00100000:0.0:1789135856.497679:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724992 00000100:00100000:0.0:1789135856.497687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725504 00000100:00100000:0.0:1789135856.497689:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725504 00000100:00100000:0.0:1789135856.497708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724736 00000100:00100000:0.0:1789135856.497711:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724736 00000100:00100000:0.0:1789135856.497723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789135856.497730:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666724608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.498250:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666724480:12345-0@lo:400:kworker.0 Request processed in 1254us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.498259:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789135856.507178:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666724608:12345-0@lo:400:kworker.0 Request processed in 9436us (11247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.507195:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789135856.507237:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789135856.507252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666725120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.507333:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6410780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666725120:12345-0@lo:400:kworker.0 Request processed in 89us (11346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.507340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789135856.507353:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789135856.507360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666724992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.507392:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666724992:12345-0@lo:400:kworker.0 Request processed in 33us (10725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.507397:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789135856.507409:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789135856.507415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666725504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.507466:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666725504:12345-0@lo:400:kworker.0 Request processed in 51us (10745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.507472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789135856.507484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789135856.507490:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666724736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.507519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6411e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666724736:12345-0@lo:400:kworker.0 Request processed in 29us (10705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.507525:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1789135856.507550:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135856.507556:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135856.507627:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666724864:0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.507663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135856.507698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666725376:0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.507716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135856.507730:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666725888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135856.507751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135856.507780:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725888 00000100:00100000:0.0:1789135856.507787:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725888 00000100:00100000:0.0:1789135856.507831:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789135856.507850:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666725888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135856.508461:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135856.508508:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666725888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 670us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.508515:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789135856.508539:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135856.508565:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3de00 x1876044666725888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135856.508593:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666725888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135856.508617:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725376 00000100:00100000:0.0:1789135856.508621:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725376 00000100:00100000:0.0:1789135856.508652:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789135856.508659:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666725376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135856.508695:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666725376:12345-0@lo:400:kworker.0 Request processed in 37us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135856.508701:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1789135856.508717:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135856.508733:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666725376:0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.508838:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666724864 00000100:00100000:2.0:1789135856.508842:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666724864 00000100:00100000:2.0:1789135856.508901:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135856.508916:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666724864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.508959:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666724864:12345-0@lo:400:kworker.0 Request processed in 45us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.508965:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135856.516094:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666724480:0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.516120:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666724992:0@lo:400:kworker.0 00010000:00080000:2.0:1789135856.516135:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55ade00 x1876044666725504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135856.516146:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666725504:0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.516159:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666724608:0@lo:400:kworker.0 00010000:00080000:2.0:1789135856.516170:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c9678b40 x1876044666725120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135856.516178:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666725120:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.520178:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f64130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666725760:0@lo:400:kworker.0 00000100:00100000:1.0:1789135856.520246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135856.529745:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725248 00000100:00100000:3.0:1789135856.529761:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725248 00000100:00100000:2.0:1789135856.530059:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789135856.530075:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666725248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.530181:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666725248:12345-0@lo:400:kworker.0 Request processed in 112us (33333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.530190:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789135856.530553:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666724864:0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.541965:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666725760 00000100:00100000:2.0:1789135856.541979:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666725760 00000100:00100000:2.0:1789135856.542059:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789135856.542069:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666725760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135856.542156:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666725760:12345-0@lo:400:kworker.0 Request processed in 89us (21909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135856.542177:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789135856.542303:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135856.542572:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666724736:0@lo:400:kworker.0 00010000:00080000:1.0:1789135856.542594:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c9679680 x1876044666725248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135856.542604:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666725248:0@lo:400:kworker.0 00010000:00080000:1.0:1789135856.542614:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f64130c0 x1876044666725760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135856.542623:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f64130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666725760:0@lo:400:kworker.0 00010000:00010000:1.0:1789135856.878999:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135857.002272:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f64130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666726016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135857.002345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135857.002419:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726016 00000100:00100000:1.0:1789135857.002426:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726016 00000100:00100000:1.0:1789135857.002472:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789135857.002480:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666726016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135857.002509:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135857.002553:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666726016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135857.002560:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789135857.004195:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f64130c0 x1876044666726016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135857.004221:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f64130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666726016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135857.004244:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135857.004252:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666726144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135857.004299:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135857.007526:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726144 00000100:00100000:3.0:1789135857.007542:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726144 00000100:00100000:2.0:1789135857.007766:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789135857.007776:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666726144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135857.007805:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135857.008124:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666726144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 349us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135857.008132:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789135857.016319:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662b840 x1876044666726144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135857.016350:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666726144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135857.513388:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135857.513412:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666726272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135857.513487:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135857.519509:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726272 00000100:00100000:1.0:1789135857.519523:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726272 00000100:00100000:1.0:1789135857.519608:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789135857.519618:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666726272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135857.519658:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135857.519760:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666726272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (6272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135857.519768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789135857.519822:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666726272:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135857.907574:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135858.165138:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135858.165902:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135858.165929:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135858.165949:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135858.165975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135858.165993:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135858.166034:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135858.166245:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629504 00000100:00100000:3.0:1789135858.166254:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629504 00000100:00100000:3.0:1789135858.166318:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629376 00000100:00100000:3.0:1789135858.166321:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629376 00000100:00100000:3.0:1789135858.166347:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1789135858.166357:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629504:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135858.166441:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629504:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 85us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135858.166448:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1789135858.166466:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:3.0:1789135858.166472:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629376:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135858.166496:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629376:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135858.166502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00080000:2.0:1789135858.169333:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135858.169343:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135858.173276:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628992 00000100:00100000:2.0:1789135858.173292:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628992 00000100:00100000:2.0:1789135858.173358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629248 00000100:00100000:2.0:1789135858.173362:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629248 00000100:00100000:2.0:1789135858.173378:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628864 00000100:00100000:2.0:1789135858.173381:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628864 00000100:00100000:2.0:1789135858.173393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629120 00000100:00100000:2.0:1789135858.173396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629120 00000100:00100000:2.0:1789135858.173416:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 151 00000100:00100000:2.0:1789135858.173425:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644628992:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135858.173511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644628992:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 86us (7611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135858.173535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 151 00000100:00100000:2.0:1789135858.173554:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:2.0:1789135858.173560:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629248:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135858.173584:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629248:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (7655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135858.173590:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:2.0:1789135858.173599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 153 00000100:00100000:2.0:1789135858.173604:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644628864:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135858.173622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644628864:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 18us (7647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135858.173628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 153 00000100:00100000:2.0:1789135858.173636:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:2.0:1789135858.173641:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629120:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135858.173658:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644629120:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 17us (7664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135858.173663:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00080000:1.0:1789135858.174274:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135858.174287:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135858.178278:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644628736 00000100:00100000:0.0:1789135858.178293:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644628736 00000100:00100000:0.0:1789135858.178396:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 308 00000100:00100000:0.0:1789135858.178407:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644628736:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135858.178487:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644628736:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 81us (13358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135858.178494:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 308 00010000:00010000:1.0:1789135858.920492:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789135859.053429:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00100000:0.0:1789135859.057048:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00100000:3.0:1789135859.057850:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00100000:2.0:1789135859.059428:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00010000:00010000:3.0:1789135859.953933:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135860.972726:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135861.096053:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666726400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135861.096143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.096306:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726400 00000100:00100000:1.0:1789135861.096315:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726400 00000100:00100000:1.0:1789135861.096378:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789135861.096387:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666726400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135861.096420:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135861.096472:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666726400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135861.096479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789135861.096886:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666726400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135861.609349:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135861.609374:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666726528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135861.609448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.609602:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726528 00000100:00100000:1.0:1789135861.609608:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726528 00000100:00100000:1.0:1789135861.609658:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135861.609669:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666726528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135861.609709:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135861.609751:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666726528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135861.609758:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789135861.609783:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6889a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666726784:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.609810:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.609829:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666727296:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.609851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.609904:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666727808:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.609931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.609951:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135861.609957:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666726912:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.609977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.610002:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666727424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.610131:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726784 00000100:00100000:2.0:1789135861.610141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726784 00000100:00100000:2.0:1789135861.610173:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727296 00000100:00100000:2.0:1789135861.610176:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727296 00000100:00100000:2.0:1789135861.610190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726912 00000100:00100000:2.0:1789135861.610193:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726912 00000100:00100000:2.0:1789135861.610206:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789135861.610212:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666726784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135861.610313:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666727040:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.618153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789135861.618174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666727296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.618277:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666727296:12345-0@lo:400:kworker.0 Request processed in 112us (8425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.618285:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789135861.618315:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789135861.618322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666726912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.618352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2312580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666726912:12345-0@lo:400:kworker.0 Request processed in 32us (8374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.618359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789135861.618478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666726784:12345-0@lo:400:kworker.0 Request processed in 8264us (8665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.618486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1789135861.619179:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135861.619187:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135861.619224:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666726656:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.619271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135861.619311:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666727168:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.619338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135861.619356:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666727680:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.619377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789135861.619416:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3fc00 x1876044666726528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135861.619440:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666726528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135861.619486:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135861.619493:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135861.619520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135861.619549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666726656 00000100:00100000:2.0:1789135861.619555:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666726656 00000100:00100000:2.0:1789135861.622892:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789135861.622920:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666726656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.623042:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666726656:12345-0@lo:400:kworker.0 Request processed in 136us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.623050:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789135861.623100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727168 00000100:00100000:2.0:1789135861.623110:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727168 00000100:00100000:2.0:1789135861.623151:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727680 00000100:00100000:2.0:1789135861.623154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727680 00000100:00100000:2.0:1789135861.623174:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789135861.623180:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666727168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.623214:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666727168:12345-0@lo:400:kworker.0 Request processed in 34us (3876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.623221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789135861.623234:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789135861.623240:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666727680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.623268:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666727680:12345-0@lo:400:kworker.0 Request processed in 29us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.623274:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789135861.623296:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728064 00000100:00100000:2.0:1789135861.623300:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728064 00000100:00100000:2.0:1789135861.623331:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789135861.623351:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666728064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135861.623368:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135861.623399:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666728064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.623405:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789135861.623422:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135861.623426:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135861.623428:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789135861.623470:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3e940 x1876044666728064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135861.623490:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135861.623501:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666726656:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.623510:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666727168:0@lo:400:kworker.0 00010000:00080000:2.0:1789135861.623520:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f688a1c0 x1876044666727680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135861.623529:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666727680:0@lo:400:kworker.0 00000100:00100000:0.0:1789135861.628434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.628478:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f688a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666727552:0@lo:400:kworker.0 00000100:00100000:0.0:1789135861.628506:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135861.628539:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727552 00000100:00100000:0.0:1789135861.628546:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727552 00000100:00100000:0.0:1789135861.628598:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789135861.628606:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666727552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135861.628646:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666727552:12345-0@lo:400:kworker.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135861.628653:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1789135861.628671:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135861.628708:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666727552:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.629049:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727040 00000100:00100000:2.0:1789135861.629054:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727040 00000100:00100000:2.0:1789135861.629097:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789135861.629105:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666727040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.629150:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666727040:12345-0@lo:400:kworker.0 Request processed in 46us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.629156:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789135861.629590:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666727040:0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.631428:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727808 00000100:00100000:2.0:1789135861.631453:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727808 00000100:00100000:2.0:1789135861.631561:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789135861.631572:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666727808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135861.631646:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666727808:12345-0@lo:400:kworker.0 Request processed in 77us (21713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135861.631653:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789135861.633000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.633054:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c23112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666727936:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.633093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135861.633120:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727424 00000100:00100000:1.0:1789135861.633125:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727424 00000100:00100000:1.0:1789135861.633159:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666727936 00000100:00100000:1.0:1789135861.633162:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666727936 00000100:00080000:0.0:1789135861.634625:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135861.642004:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789135861.642042:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666727424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135861.642146:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666727424:12345-0@lo:400:kworker.0 Request processed in 128us (9159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135861.642154:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789135861.642562:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789135861.642572:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666727936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.642609:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666727936:12345-0@lo:400:kworker.0 Request processed in 40us (9516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135861.642616:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789135861.642660:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c23112c0 x1876044666727936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135861.642676:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c23112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666727936:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.642691:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6889a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666726784:0@lo:400:kworker.0 00010000:00080000:1.0:1789135861.642785:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f688b840 x1876044666727296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135861.642794:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666727296:0@lo:400:kworker.0 00010000:00080000:1.0:1789135861.642826:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2311680 x1876044666727808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135861.642834:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666727808:0@lo:400:kworker.0 00000100:00100000:1.0:1789135861.642886:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666726912:0@lo:400:kworker.0 00010000:00080000:1.0:1789135861.642896:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f688b0c0 x1876044666727424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135861.642904:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f688b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666727424:0@lo:400:kworker.0 00010000:00010000:3.0:1789135861.993316:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135862.121102:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135862.121127:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666728192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135862.121218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135862.121322:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728192 00000100:00100000:2.0:1789135862.121330:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728192 00000100:00100000:2.0:1789135862.121386:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789135862.121397:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666728192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135862.121441:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135862.121490:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666728192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135862.121499:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789135862.121602:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135862.121613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666728320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135862.121641:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135862.121668:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728320 00000100:00100000:3.0:1789135862.121673:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728320 00000100:00100000:3.0:1789135862.121696:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135862.121703:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666728320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135862.121713:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135862.121740:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666728320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135862.121746:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1789135862.121780:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662b480 x1876044666728320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135862.121799:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666728320:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789135862.123000:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2311680 x1876044666728192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135862.123023:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666728192:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789135862.620364:0:12186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1789135862.632180:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666728448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135862.632267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135862.632366:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728448 00000100:00100000:3.0:1789135862.632375:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728448 00000100:00100000:3.0:1789135862.632427:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789135862.632436:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666728448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135862.632485:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135862.632549:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666728448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135862.632557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789135862.632604:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2311680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666728448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135863.035901:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135863.287003:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287052:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287089:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287124:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287142:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287158:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135863.287225:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630400 00000100:00100000:1.0:1789135863.287244:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630400 00000100:00100000:0.0:1789135863.287470:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629888 00000100:00100000:0.0:1789135863.287475:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629888 00000100:00100000:0.0:1789135863.287503:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630144 00000100:00100000:0.0:1789135863.287506:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630144 00000100:00100000:0.0:1789135863.287519:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629760 00000100:00100000:0.0:1789135863.287521:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629760 00000100:00100000:0.0:1789135863.287532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630016 00000100:00100000:0.0:1789135863.287534:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630016 00000100:00100000:0.0:1789135863.287570:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:0.0:1789135863.287579:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644629888:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135863.287657:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644629888:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 79us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135863.287677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:0.0:1789135863.287697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:0.0:1789135863.287703:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630144:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135863.287727:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630144:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135863.287733:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:0.0:1789135863.287743:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:0.0:1789135863.287748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644629760:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135863.287770:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644629760:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135863.287776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:0.0:1789135863.287786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:0.0:1789135863.287792:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630016:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135863.287813:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630016:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135863.287819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00080000:0.0:1789135863.287843:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135863.287847:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135863.287849:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135863.287906:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630272 00000100:00100000:0.0:1789135863.287917:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630272 00000100:00100000:0.0:1789135863.287949:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:0.0:1789135863.287956:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630400:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135863.287997:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630400:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 42us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135863.288003:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:0.0:1789135863.288017:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:0.0:1789135863.288023:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630272:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135863.288047:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630272:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135863.288053:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00080000:0.0:1789135863.288069:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135863.288619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644629632 00000100:00100000:2.0:1789135863.288625:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644629632 00000100:00100000:2.0:1789135863.288680:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 310 00000100:00100000:2.0:1789135863.288688:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644629632:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135863.288719:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644629632:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135863.288726:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 310 00010000:00010000:3.0:1789135864.040404:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135865.078710:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135866.088634:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135866.216447:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135866.216478:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666728576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135866.216574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135866.216676:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728576 00000100:00100000:0.0:1789135866.217117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728576 00000100:00100000:0.0:1789135866.217533:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789135866.217544:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666728576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135866.217591:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135866.217968:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666728576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 424us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135866.217978:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789135866.228400:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666728576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135866.728156:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666728832:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.728265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.728344:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666729344:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.728365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.728391:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666729856:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.728412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.728444:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135866.728450:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666728960:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.728473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.728491:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666729472:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.728519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.728539:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666729984:0@lo:400:kworker.0 00000100:00100000:1.0:1789135866.728559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.728763:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666729088:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.728797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.728816:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666729600:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.728835:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.728850:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666730112:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.728894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.728927:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789135866.728932:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666728704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.728963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.728986:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666729216:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.729015:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666729728:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729037:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135866.729072:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729088 00000100:00100000:3.0:1789135866.729081:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729088 00000100:00100000:3.0:1789135866.729136:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789135866.729145:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666729088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729215:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666729088:12345-0@lo:400:kworker.0 Request processed in 70us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.729223:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789135866.729250:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729472 00000100:00100000:3.0:1789135866.729253:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729472 00000100:00100000:3.0:1789135866.729298:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729984 00000100:00100000:3.0:1789135866.729302:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729984 00000100:00100000:3.0:1789135866.729337:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729600 00000100:00100000:3.0:1789135866.729340:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729600 00000100:00100000:3.0:1789135866.729354:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730112 00000100:00100000:3.0:1789135866.729356:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730112 00000100:00100000:3.0:1789135866.729372:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135866.729378:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666729472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729418:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666729472:12345-0@lo:400:kworker.0 Request processed in 41us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.729425:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135866.729439:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789135866.729445:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666729984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729472:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666729984:12345-0@lo:400:kworker.0 Request processed in 28us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.729478:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789135866.729487:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789135866.729491:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666729600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729514:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666729600:12345-0@lo:400:kworker.0 Request processed in 23us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.729520:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789135866.729529:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789135866.729539:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666730112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729563:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666730112:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.729569:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789135866.729597:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728704 00000100:00100000:3.0:1789135866.729601:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728704 00000100:00100000:3.0:1789135866.729625:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789135866.729631:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666728704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729657:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666728704:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.729663:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:3.0:1789135866.729692:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135866.729696:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135866.729721:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666728704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729734:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666729088:0@lo:400:kworker.0 00010000:00080000:3.0:1789135866.729746:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69ead00 x1876044666729600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.729756:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666729600:0@lo:400:kworker.0 00010000:00080000:3.0:1789135866.729765:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f861c0 x1876044666730112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.729774:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666730112:0@lo:400:kworker.0 00010000:00080000:3.0:1789135866.729812:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e8f00 x1876044666729472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.729820:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666729472:0@lo:400:kworker.0 00010000:00080000:3.0:1789135866.729839:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e9a40 x1876044666729984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.729848:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666729984:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.729943:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728832 00000100:00100000:3.0:1789135866.729948:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728832 00000100:00100000:3.0:1789135866.729968:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729344 00000100:00100000:3.0:1789135866.729971:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729344 00000100:00100000:3.0:1789135866.729986:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729856 00000100:00100000:3.0:1789135866.729989:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729856 00000100:00100000:3.0:1789135866.729999:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666728960 00000100:00100000:3.0:1789135866.730002:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666728960 00000100:00100000:3.0:1789135866.730011:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729216 00000100:00100000:3.0:1789135866.730013:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729216 00000100:00100000:3.0:1789135866.730025:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666729728 00000100:00100000:3.0:1789135866.730027:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666729728 00000100:00100000:3.0:1789135866.730041:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135866.730047:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666728832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730083:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666728832:12345-0@lo:400:kworker.0 Request processed in 37us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.730089:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135866.730100:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135866.730105:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666729344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730130:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666729344:12345-0@lo:400:kworker.0 Request processed in 25us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.730137:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135866.730145:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789135866.730150:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666729856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730182:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666729856:12345-0@lo:400:kworker.0 Request processed in 32us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.730188:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789135866.730199:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789135866.730204:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666728960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730229:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666728960:12345-0@lo:400:kworker.0 Request processed in 25us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.730235:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789135866.730247:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789135866.730253:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666729216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730282:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6629e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666729216:12345-0@lo:400:kworker.0 Request processed in 29us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.730288:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789135866.730298:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789135866.730304:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666729728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730331:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666729728:12345-0@lo:400:kworker.0 Request processed in 27us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.730337:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:3.0:1789135866.730364:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135866.730367:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135866.730387:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666729216:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730399:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666729728:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730425:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666728960:0@lo:400:kworker.0 00000100:00100000:3.0:1789135866.730436:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666728832:0@lo:400:kworker.0 00010000:00080000:3.0:1789135866.730454:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69ea940 x1876044666729344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.730463:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666729344:0@lo:400:kworker.0 00010000:00080000:3.0:1789135866.730472:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e9e00 x1876044666729856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.730479:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666729856:0@lo:400:kworker.0 00000100:00100000:2.0:1789135866.731159:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666730240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135866.731211:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.731307:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666730368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135866.731335:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135866.731366:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730240 00000100:00100000:1.0:1789135866.731403:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730240 00000100:00100000:1.0:1789135866.731439:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730368 00000100:00100000:1.0:1789135866.731441:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730368 00000100:00100000:1.0:1789135866.731455:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135866.731461:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666730240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135866.731491:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135866.731574:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135866.731596:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666730368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135866.731607:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135866.731638:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666730368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135866.731644:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789135866.738670:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f86940 x1876044666730368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135866.738709:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666730368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135866.742247:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666730240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10767us (11016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135866.742267:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789135866.760453:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e9e00 x1876044666730240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135866.760509:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666730240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789135867.118244:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135867.243074:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666730496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135867.243160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135867.243275:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730496 00000100:00100000:1.0:1789135867.243282:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730496 00000100:00100000:1.0:1789135867.243330:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789135867.243339:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666730496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789135867.243369:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135867.243414:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666730496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135867.243421:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789135867.243444:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666730624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135867.243471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135867.243500:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730624 00000100:00100000:1.0:1789135867.243504:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730624 00000100:00100000:1.0:1789135867.243527:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789135867.243532:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666730624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135867.243543:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135867.243572:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666730624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135867.243578:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1789135867.243612:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3f86d00 x1876044666730624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135867.243629:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666730624:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789135867.243655:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69ea940 x1876044666730496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135867.243665:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666730496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135867.754471:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135867.754494:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666730752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135867.754609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135867.754987:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730752 00000100:00100000:0.0:1789135867.754996:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730752 00000100:00100000:0.0:1789135867.755067:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789135867.755077:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666730752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789135867.755221:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789135867.755281:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666730752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 206us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135867.755443:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666730752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135867.755493:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1789135868.136267:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135868.417548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417585:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417610:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417639:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417659:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417696:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135868.417734:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630656 00000100:00100000:2.0:1789135868.417744:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630656 00000100:00100000:2.0:1789135868.417807:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630912 00000100:00100000:2.0:1789135868.417810:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630912 00000100:00100000:2.0:1789135868.417826:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630784 00000100:00100000:2.0:1789135868.417829:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630784 00000100:00100000:2.0:1789135868.417840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631040 00000100:00100000:2.0:1789135868.417842:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631040 00000100:00100000:2.0:1789135868.417889:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1789135868.417898:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644630656:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.417971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644630656:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 74us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.417977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1789135868.417994:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:2.0:1789135868.418000:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630912:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.418022:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644630912:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.418028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:2.0:1789135868.418053:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:2.0:1789135868.418059:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644630784:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.418084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644630784:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.418089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:2.0:1789135868.418113:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:2.0:1789135868.418120:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644631040:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.418141:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644631040:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.418146:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:2.0:1789135868.418165:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631168 00000100:00100000:2.0:1789135868.418168:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631168 00000100:00100000:2.0:1789135868.418193:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631296 00000100:00100000:2.0:1789135868.418195:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631296 00000100:00100000:2.0:1789135868.418215:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:2.0:1789135868.418222:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644631168:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.418247:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644631168:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.418253:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:2.0:1789135868.418264:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1789135868.418270:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644631296:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.418290:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644631296:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.418296:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1789135868.418321:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644630528 00000100:00100000:2.0:1789135868.418325:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644630528 00000100:00100000:2.0:1789135868.418349:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 312 00000100:00100000:2.0:1789135868.418355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644630528:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135868.418381:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644630528:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135868.418387:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 312 00000100:00080000:2.0:1789135868.418418:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135868.418421:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135868.418424:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135868.418426:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135869.163743:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135870.196619:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135871.210242:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135871.337766:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135871.337796:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666730880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135871.337922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135871.338266:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666730880 00000100:00100000:3.0:1789135871.338274:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666730880 00000100:00100000:3.0:1789135871.338334:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789135871.338357:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666730880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135871.338395:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135871.338483:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666730880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135871.338491:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789135871.339124:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666730880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135871.848259:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666731008:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848396:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666731520:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848425:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848456:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666732032:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848503:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789135871.848509:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666731392:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848532:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848549:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666731904:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848586:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666732416:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848630:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666731264:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848685:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666731776:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848732:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666732288:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848785:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789135871.848792:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666731136:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848844:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666731648:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848898:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666732160:0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.848915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135871.848938:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731008 00000100:00100000:2.0:1789135871.848945:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731008 00000100:00100000:2.0:1789135871.848990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789135871.848996:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666731008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849046:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666731008:12345-0@lo:400:kworker.0 Request processed in 49us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849054:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789135871.849086:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731520 00000100:00100000:2.0:1789135871.849089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731520 00000100:00100000:2.0:1789135871.849119:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732032 00000100:00100000:2.0:1789135871.849121:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732032 00000100:00100000:2.0:1789135871.849132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731264 00000100:00100000:2.0:1789135871.849134:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731264 00000100:00100000:2.0:1789135871.849142:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731136 00000100:00100000:2.0:1789135871.849144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731136 00000100:00100000:2.0:1789135871.849163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731648 00000100:00100000:2.0:1789135871.849165:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731648 00000100:00100000:2.0:1789135871.849179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732160 00000100:00100000:2.0:1789135871.849181:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732160 00000100:00100000:2.0:1789135871.849193:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789135871.849199:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666731520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666731520:12345-0@lo:400:kworker.0 Request processed in 29us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849231:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789135871.849245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789135871.849249:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666732032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849269:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666732032:12345-0@lo:400:kworker.0 Request processed in 20us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849274:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789135871.849283:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789135871.849289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6889a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666731264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6889a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666731264:12345-0@lo:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849317:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789135871.849327:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789135871.849332:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666731136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849352:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666731136:12345-0@lo:400:kworker.0 Request processed in 21us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789135871.849366:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789135871.849372:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666731648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666731648:12345-0@lo:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849410:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789135871.849420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789135871.849426:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666732160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.849451:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666732160:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.849456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789135871.849477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731392 00000100:00100000:2.0:1789135871.849480:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731392 00000100:00100000:3.0:1789135871.850466:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135871.850483:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666732544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135871.850553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135871.850733:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732544 00000100:00100000:1.0:1789135871.850738:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732544 00000100:00100000:1.0:1789135871.850776:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135871.850784:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666732544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135871.850818:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135871.850874:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666732544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135871.850880:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789135871.850931:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666732672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135871.850955:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135871.850997:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732672 00000100:00100000:1.0:1789135871.851001:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732672 00000100:00100000:1.0:1789135871.851022:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789135871.851027:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666732672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135871.851038:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135871.851067:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666732672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135871.851072:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789135871.851102:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da70c0 x1876044666732544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135871.851138:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666732544:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789135871.851167:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da43c0 x1876044666732672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135871.851179:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666732672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135871.851380:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731904 00000100:00100000:3.0:1789135871.851385:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731904 00000100:00100000:3.0:1789135871.851403:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732416 00000100:00100000:3.0:1789135871.851405:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732416 00000100:00100000:3.0:1789135871.851416:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666731776 00000100:00100000:3.0:1789135871.851418:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666731776 00000100:00100000:3.0:1789135871.851425:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732288 00000100:00100000:3.0:1789135871.851428:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732288 00000100:00100000:3.0:1789135871.852880:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135871.852898:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666731904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.852964:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666731904:12345-0@lo:400:kworker.0 Request processed in 74us (4391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135871.852971:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789135871.852988:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789135871.852994:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666732416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853023:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666732416:12345-0@lo:400:kworker.0 Request processed in 30us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135871.853031:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789135871.853041:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789135871.853047:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666731776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853089:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666731776:12345-0@lo:400:kworker.0 Request processed in 42us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135871.853095:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789135871.853106:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789135871.853112:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666732288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853138:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666732288:12345-0@lo:400:kworker.0 Request processed in 26us (4384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135871.853142:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789135871.853204:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135871.853209:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135871.853212:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135871.853215:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789135871.853250:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d912c0 x1876044666731904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135871.853263:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666731904:0@lo:400:kworker.0 00010000:00080000:3.0:1789135871.853275:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da5a40 x1876044666732416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135871.853283:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666732416:0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853292:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666731008:0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666731520:0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853314:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666732032:0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853357:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666731136:0@lo:400:kworker.0 00010000:00080000:3.0:1789135871.853371:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91680 x1876044666731648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135871.853387:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666731648:0@lo:400:kworker.0 00010000:00080000:3.0:1789135871.853401:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da61c0 x1876044666732160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135871.853409:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666732160:0@lo:400:kworker.0 00000100:00100000:3.0:1789135871.853421:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666731264:0@lo:400:kworker.0 00010000:00080000:3.0:1789135871.853431:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92580 x1876044666731776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135871.854542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789135871.854559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666731392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135871.854691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666731392:12345-0@lo:400:kworker.0 Request processed in 138us (6157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135871.854698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789135871.854813:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666731776:0@lo:400:kworker.0 00010000:00080000:3.0:1789135871.854836:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da4f00 x1876044666732288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135871.854846:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666732288:0@lo:400:kworker.0 00000100:00100000:0.0:1789135871.869491:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666731392:0@lo:400:kworker.0 00010000:00010000:1.0:1789135872.232161:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135872.363843:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135872.363879:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666732800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135872.363952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135872.364011:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732800 00000100:00100000:1.0:1789135872.364018:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732800 00000100:00100000:1.0:1789135872.364078:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789135872.364087:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666732800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135872.364118:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135872.364174:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666732800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135872.364180:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789135872.364223:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da43c0 x1876044666732800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135872.364242:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666732800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135872.366967:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135872.366996:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666732928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135872.367265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135872.375381:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666732928 00000100:00100000:2.0:1789135872.375395:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666732928 00000100:00100000:2.0:1789135872.375464:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789135872.375476:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666732928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135872.375502:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135872.375585:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666732928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (8321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135872.375593:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789135872.375640:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4467480 x1876044666732928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135872.375661:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666732928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135872.875145:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135872.875171:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666733056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135872.875239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135872.875718:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733056 00000100:00100000:0.0:1789135872.875727:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733056 00000100:00100000:0.0:1789135872.875775:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135872.875794:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666733056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789135872.875828:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789135872.875953:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666733056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135872.875960:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789135872.876003:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666733056:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789135873.256043:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135873.529664:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135873.529713:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135873.529803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135873.529909:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631424 00000100:00100000:2.0:1789135873.529919:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631424 00000100:00100000:2.0:1789135873.529971:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 314 00000100:00100000:2.0:1789135873.529982:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644631424:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135873.530070:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644631424:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135873.530079:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 314 00000100:00100000:3.0:1789135873.554298:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631552 00000100:00100000:3.0:1789135873.554318:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631552 00000100:00100000:3.0:1789135873.554439:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135873.554478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135873.554504:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631808 00000100:00100000:3.0:1789135873.554508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631808 00000100:00100000:3.0:1789135873.554555:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631680 00000100:00100000:3.0:1789135873.554557:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631680 00000100:00100000:3.0:1789135873.554570:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644631936 00000100:00100000:3.0:1789135873.554572:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644631936 00000100:00100000:3.0:1789135873.554606:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 181 00000100:00100000:3.0:1789135873.554616:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644631808:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135873.554696:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644631808:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 82us (24892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.554703:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 181 00000100:00100000:3.0:1789135873.554721:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:3.0:1789135873.554728:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644631680:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135873.554752:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644631680:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.554758:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:3.0:1789135873.554768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:3.0:1789135873.554784:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644631936:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135873.554815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644631936:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 42us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.554821:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00080000:3.0:1789135873.554836:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135873.554841:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135873.554889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135873.554912:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632064 00000100:00100000:3.0:1789135873.554916:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632064 00000100:00100000:3.0:1789135873.554947:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1789135873.554953:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2388:x1876044644632064:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:3.0:1789135873.554972:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2acc 00000100:00080000:3.0:1789135873.554981:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a7ff593000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789135873.555101:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789135873.555234:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+2:2388:x1876044644632064:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 281us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.555242:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00080000:3.0:1789135873.555256:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135873.555314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135873.555330:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632192 00000100:00100000:3.0:1789135873.555334:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632192 00000100:00100000:3.0:1789135873.555361:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789135873.555367:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2388:x1876044644632192:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:3.0:1789135873.555381:0:8536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2ad3 00000100:00080000:3.0:1789135873.555386:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a7ff590000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789135873.555405:0:8536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789135873.555472:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+2:2388:x1876044644632192:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 104us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.555479:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00080000:3.0:1789135873.555491:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789135873.556390:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135873.556410:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135873.558249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00100000:3.0:1789135873.558261:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644631552:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135873.558329:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644631552:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 70us (28615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135873.558336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00080000:1.0:1789135873.558565:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789135874.283217:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789135874.790594:0:12503:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789135874.791311:0:12503:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789135875.307769:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135876.329555:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135876.457165:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135876.457188:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666733184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135876.457257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135876.457889:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733184 00000100:00100000:2.0:1789135876.457898:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733184 00000100:00100000:2.0:1789135876.457961:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789135876.457971:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666733184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789135876.458007:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789135876.458069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666733184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135876.458076:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789135876.458133:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666733184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135876.970007:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666733312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135876.970082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970161:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733312 00000100:00100000:1.0:1789135876.970169:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733312 00000100:00100000:1.0:1789135876.970227:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789135876.970237:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666733312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135876.970269:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135876.970314:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666733312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.970321:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789135876.970342:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135876.970431:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da61c0 x1876044666733312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.970449:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666733312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135876.970564:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666733440:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970629:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666733952:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970673:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666734464:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970744:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135876.970750:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666733568:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970791:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666734080:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970823:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666734592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.970895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733952 00000100:00100000:1.0:1789135876.970899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733952 00000100:00100000:1.0:1789135876.970930:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789135876.970937:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666733952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.970976:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666733952:12345-0@lo:400:kworker.0 Request processed in 40us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.970983:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789135876.971000:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734464 00000100:00100000:1.0:1789135876.971003:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734464 00000100:00100000:1.0:1789135876.971028:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733568 00000100:00100000:1.0:1789135876.971031:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733568 00000100:00100000:1.0:1789135876.971040:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734080 00000100:00100000:1.0:1789135876.971041:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734080 00000100:00100000:1.0:1789135876.971053:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734592 00000100:00100000:1.0:1789135876.971055:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734592 00000100:00100000:1.0:1789135876.971066:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789135876.971071:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666734464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971099:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666734464:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971105:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789135876.971116:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789135876.971131:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666733568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971163:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666733568:12345-0@lo:400:kworker.0 Request processed in 33us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971169:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789135876.971180:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789135876.971187:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666734080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971212:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666734080:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971217:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789135876.971228:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789135876.971234:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666734592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971258:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666734592:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971263:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789135876.971291:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666733696:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.971352:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666734208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.971389:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666734720:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.971431:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789135876.971438:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666733824:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.971473:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666734336:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.971525:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666734848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135876.971572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733696 00000100:00100000:1.0:1789135876.971575:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733696 00000100:00100000:1.0:1789135876.971603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789135876.971610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666733696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971641:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666733696:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971647:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789135876.971663:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734720 00000100:00100000:1.0:1789135876.971666:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734720 00000100:00100000:1.0:1789135876.971687:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734336 00000100:00100000:1.0:1789135876.971690:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734336 00000100:00100000:1.0:1789135876.971701:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734848 00000100:00100000:1.0:1789135876.971704:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734848 00000100:00100000:1.0:1789135876.971730:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135876.971737:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666734720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971767:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666734720:12345-0@lo:400:kworker.0 Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971773:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789135876.971784:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135876.971790:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666734336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971814:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666734336:12345-0@lo:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971820:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789135876.971830:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135876.971842:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666734848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971892:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666734848:12345-0@lo:400:kworker.0 Request processed in 50us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971897:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135876.971920:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734208 00000100:00100000:1.0:1789135876.971924:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734208 00000100:00100000:1.0:1789135876.971944:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733824 00000100:00100000:1.0:1789135876.971947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733824 00000100:00100000:1.0:1789135876.971957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789135876.971963:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666734208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.971991:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666734208:12345-0@lo:400:kworker.0 Request processed in 28us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.971996:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789135876.972006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789135876.972012:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666733824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.972033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666733824:12345-0@lo:400:kworker.0 Request processed in 21us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135876.972037:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1789135876.972052:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135876.972055:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135876.972058:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135876.972060:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135876.972090:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666733824:0@lo:400:kworker.0 00010000:00080000:1.0:1789135876.972101:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b03840 x1876044666734336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.972111:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666734336:0@lo:400:kworker.0 00010000:00080000:1.0:1789135876.972130:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b00000 x1876044666734848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.972139:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666734848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.972148:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666733696:0@lo:400:kworker.0 00010000:00080000:1.0:1789135876.972155:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b021c0 x1876044666734208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.972162:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666734208:0@lo:400:kworker.0 00010000:00080000:1.0:1789135876.972170:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b030c0 x1876044666734720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.972177:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666734720:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.972214:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666733568:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.972225:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666734080:0@lo:400:kworker.0 00010000:00080000:1.0:1789135876.972234:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b003c0 x1876044666734592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.972243:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666734592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.972253:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666733952:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.972262:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666734464:0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.974926:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666733440 00000100:00100000:3.0:1789135876.974942:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666733440 00000100:00100000:3.0:1789135876.975012:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789135876.975023:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666733440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135876.975119:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666733440:12345-0@lo:400:kworker.0 Request processed in 98us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135876.975139:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789135876.975195:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666733440:0@lo:400:kworker.0 00000100:00100000:1.0:1789135876.977145:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666734976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135876.977211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135876.977284:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666734976 00000100:00100000:2.0:1789135876.977291:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666734976 00000100:00100000:2.0:1789135876.977335:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789135876.977345:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666734976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135876.977366:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135876.989386:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666734976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12032us (12164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135876.989403:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:1.0:1789135876.991050:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ff7840 x1876044666734976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135876.991098:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666734976:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789135877.352870:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789135877.353405:0:12600:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789135877.353639:0:12600:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789135877.482324:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135877.482353:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666735104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135877.482446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135877.482636:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735104 00000100:00100000:0.0:1789135877.482646:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735104 00000100:00100000:0.0:1789135877.482719:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789135877.482729:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666735104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135877.482774:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135877.482835:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666735104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135877.482842:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1789135877.482928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ff7480 x1876044666735104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135877.482950:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666735104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135877.498065:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135877.498100:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666735232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135877.498184:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135877.498981:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735232 00000100:00100000:3.0:1789135877.498990:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735232 00000100:00100000:3.0:1789135877.499746:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789135877.499770:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666735232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135877.499797:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135877.499896:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666735232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135877.499903:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789135877.500024:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e9e00 x1876044666735232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135877.500058:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666735232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135878.002647:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135878.002680:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666735360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135878.002792:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135878.004567:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735360 00000100:00100000:2.0:1789135878.004579:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735360 00000100:00100000:2.0:1789135878.004646:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135878.004657:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666735360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135878.004706:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135878.004798:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666735360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135878.004805:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789135878.006849:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666735360:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135878.376063:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135878.647667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135878.647724:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135878.647757:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135878.647779:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135878.647807:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135878.647840:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632320 00000100:00100000:0.0:1789135878.647872:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632320 00000100:00100000:0.0:1789135878.647933:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 316 00000100:00100000:0.0:1789135878.647944:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644632320:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135878.648032:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644632320:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135878.648041:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 316 00000100:00100000:0.0:1789135878.648083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632576 00000100:00100000:0.0:1789135878.648086:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632576 00000100:00100000:0.0:1789135878.648120:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632832 00000100:00100000:0.0:1789135878.648123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632832 00000100:00100000:0.0:1789135878.648150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632448 00000100:00100000:0.0:1789135878.648153:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632448 00000100:00100000:0.0:1789135878.648166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632704 00000100:00100000:0.0:1789135878.648169:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632704 00000100:00100000:0.0:1789135878.648183:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:0.0:1789135878.648190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644632576:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135878.648223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644632576:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135878.648230:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:0.0:1789135878.648242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:0.0:1789135878.648248:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644632832:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135878.648271:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644632832:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135878.648278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:0.0:1789135878.648289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:0.0:1789135878.648295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644632448:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135878.648320:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644632448:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135878.648326:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:0.0:1789135878.648337:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:0.0:1789135878.648343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644632704:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135878.648365:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644632704:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135878.648371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00080000:0.0:1789135878.654950:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135878.654981:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1789135879.017701:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000020:00000080:2.0:1789135879.017711:0:8425:0:(genops.c:885:class_export_put()) final put ffff90a7ff592800/f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00100000:2.0:1789135879.018718:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000020:00000080:2.0:1789135879.018724:0:9511:0:(genops.c:885:class_export_put()) final put ffff90a7ff597000/f8cf048c-d8c6-435a-a255-87c185db70f0 00000020:00000080:1.0:1789135879.018819:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff592800/f8cf048c-d8c6-435a-a255-87c185db70f0 for lustre-OST0000 00000020:00000080:1.0:1789135879.018886:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff597000/f8cf048c-d8c6-435a-a255-87c185db70f0 for lustre-OST0001 00000020:00000080:1.0:1789135879.018904:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff593000 for lustre-OST0000 00000020:00000080:1.0:1789135879.018973:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff590000 for lustre-OST0001 00010000:00010000:2.0:1789135879.400212:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789135880.032694:0:12697:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789135880.033323:0:12697:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789135880.429968:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135881.449032:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135881.576114:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666735488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135881.576196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135881.576292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735488 00000100:00100000:0.0:1789135881.576300:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735488 00000100:00100000:0.0:1789135881.576352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789135881.576360:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666735488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135881.576394:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135881.576441:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666735488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135881.576448:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789135881.576498:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666735488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135882.092360:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666735616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135882.092455:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135882.092552:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135882.092562:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666735744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135882.092589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135882.092616:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735616 00000100:00100000:1.0:1789135882.092635:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735616 00000100:00100000:1.0:1789135882.092687:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735744 00000100:00100000:1.0:1789135882.092691:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735744 00000100:00100000:1.0:1789135882.092711:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135882.092719:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666735616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135882.092751:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135882.092815:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666735616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.092824:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789135882.092842:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789135882.092848:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666735744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135882.092895:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135882.092923:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666735744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.092929:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789135882.092950:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135882.092994:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6609a40 x1876044666735744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135882.093017:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666735744:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789135882.093053:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66083c0 x1876044666735616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135882.093065:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666735616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135882.094720:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666736256:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.094789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.094840:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666736768:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.094957:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666735872:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135882.095027:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666736384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135882.095068:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666736896:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095089:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135882.095130:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666735872 00000100:00100000:1.0:1789135882.095137:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666735872 00000100:00100000:1.0:1789135882.095180:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789135882.095198:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666735872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095246:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666735872:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.095252:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789135882.095287:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736384 00000100:00100000:1.0:1789135882.095290:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736384 00000100:00100000:1.0:1789135882.095317:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135882.095324:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666736384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095359:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666736384:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.095365:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135882.095384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736256 00000100:00100000:1.0:1789135882.095387:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736256 00000100:00100000:1.0:1789135882.095414:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736896 00000100:00100000:1.0:1789135882.095417:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736896 00000100:00100000:1.0:1789135882.095466:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789135882.095473:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666736256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095503:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666736256:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.095509:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789135882.095521:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789135882.095528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666736896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666736896:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.095562:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1789135882.095588:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135882.095615:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666735872:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.095650:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666736384:0@lo:400:kworker.0 00010000:00080000:1.0:1789135882.095663:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d90000 x1876044666736896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135882.095674:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666736896:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.096101:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.096139:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666736256:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.096166:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736768 00000100:00100000:3.0:1789135882.096170:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736768 00000100:00100000:3.0:1789135882.096205:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789135882.096212:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666736768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.096251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666736768:12345-0@lo:400:kworker.0 Request processed in 40us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.096257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789135882.096286:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666736000:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.096313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.096331:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666736512:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.096352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.096366:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666737024:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.096389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.096410:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789135882.096416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666736128:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.097046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736000 00000100:00100000:1.0:1789135882.097053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736000 00000100:00100000:1.0:1789135882.097076:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736512 00000100:00100000:1.0:1789135882.097079:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736512 00000100:00100000:1.0:1789135882.097093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789135882.097099:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666736000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.097140:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666736000:12345-0@lo:400:kworker.0 Request processed in 41us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.097146:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789135882.097162:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789135882.097168:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666736512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.097192:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666736512:12345-0@lo:400:kworker.0 Request processed in 25us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.097197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789135882.097276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.097311:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.097353:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135882.097372:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666737152:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.097393:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135882.098249:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736640 00000100:00100000:2.0:1789135882.098258:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736640 00000100:00100000:2.0:1789135882.098300:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789135882.098307:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666736640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135882.098354:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666736640:12345-0@lo:400:kworker.0 Request processed in 47us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135882.098359:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789135882.098692:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666736128 00000100:00100000:1.0:1789135882.098697:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666736128 00000100:00100000:3.0:1789135882.099064:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666736000:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.099093:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666736512:0@lo:400:kworker.0 00010000:00080000:3.0:1789135882.099123:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91680 x1876044666736640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135882.099134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666736640:0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.099154:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737024 00000100:00100000:3.0:1789135882.099158:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737024 00000100:00100000:3.0:1789135882.099190:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737152 00000100:00100000:3.0:1789135882.099193:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737152 00000100:00100000:3.0:1789135882.099216:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135882.099223:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666737024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.099285:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666737024:12345-0@lo:400:kworker.0 Request processed in 63us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.099292:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789135882.099305:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789135882.099311:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666737152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135882.099337:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666737152:12345-0@lo:400:kworker.0 Request processed in 28us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135882.099343:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789135882.099371:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135882.099375:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135882.099378:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135882.099410:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666736768:0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.101256:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789135882.101274:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666736128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135882.101353:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666736128:12345-0@lo:400:kworker.0 Request processed in 87us (4077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135882.101359:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135882.101632:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666736128:0@lo:400:kworker.0 00010000:00080000:3.0:1789135882.101650:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d903c0 x1876044666737152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135882.101661:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666737152:0@lo:400:kworker.0 00010000:00080000:3.0:1789135882.101674:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d90780 x1876044666737024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135882.101682:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666737024:0@lo:400:kworker.0 00010000:00010000:1.0:1789135882.472234:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135882.600008:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666737280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135882.600078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135882.600342:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666737408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135882.600370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135882.600420:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737280 00000100:00100000:0.0:1789135882.600438:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737280 00000100:00100000:2.0:1789135882.604467:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737408 00000100:00100000:2.0:1789135882.604483:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737408 00000100:00100000:2.0:1789135882.604537:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789135882.604547:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666737280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135882.604579:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135882.605047:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789135882.605058:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666737408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135882.605070:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135882.605113:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666737408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135882.605119:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789135882.605178:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a4000 x1876044666737408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135882.605217:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666737408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135882.605441:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666737280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 895us (5362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135882.605448:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1789135882.606015:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4466580 x1876044666737280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135882.606093:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666737280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135883.112309:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135883.112334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666737536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135883.112412:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135883.112818:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737536 00000100:00100000:1.0:1789135883.112827:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737536 00000100:00100000:1.0:1789135883.112922:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789135883.112931:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666737536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135883.112965:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135883.113028:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666737536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135883.113035:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789135883.113263:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666737536:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789135883.493749:0:12795:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789135883.494198:0:12795:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789135883.498583:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135883.762914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135883.762951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135883.762983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135883.763005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135883.763030:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135883.763068:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644632960 00000100:00100000:3.0:1789135883.763076:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644632960 00000100:00100000:3.0:1789135883.763135:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 318 00000100:00100000:3.0:1789135883.763145:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644632960:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135883.763216:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644632960:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135883.763225:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 318 00000100:00100000:3.0:1789135883.763262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633088 00000100:00100000:3.0:1789135883.763266:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633088 00000100:00100000:3.0:1789135883.763295:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633344 00000100:00100000:3.0:1789135883.763299:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633344 00000100:00100000:3.0:1789135883.763310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633216 00000100:00100000:3.0:1789135883.763313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633216 00000100:00100000:3.0:1789135883.763322:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633472 00000100:00100000:3.0:1789135883.763324:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633472 00000100:00100000:3.0:1789135883.763336:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 201 00000100:00100000:3.0:1789135883.763342:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644633088:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135883.763371:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644633088:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135883.763377:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 201 00000100:00100000:3.0:1789135883.763388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:3.0:1789135883.763394:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644633344:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135883.763415:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644633344:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135883.763420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:3.0:1789135883.763430:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:3.0:1789135883.763436:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644633216:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135883.763470:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644633216:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 34us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135883.763475:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:3.0:1789135883.763486:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:3.0:1789135883.763492:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644633472:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135883.763511:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644633472:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135883.763517:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00080000:3.0:1789135883.763692:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135883.763697:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135884.520657:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135885.544055:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789135885.986257:0:12893:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789135885.986582:0:12893:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789135886.568938:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135886.706675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666737664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135886.706764:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135886.706972:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737664 00000100:00100000:0.0:1789135886.706981:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737664 00000100:00100000:0.0:1789135886.707035:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789135886.707045:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666737664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135886.707080:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135886.715303:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666737664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8250us (8528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135886.715326:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789135886.715575:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666737664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135887.213198:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666737920:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213461:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666738432:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213506:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666738944:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213715:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789135887.213721:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666737792:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213775:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666738304:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213800:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213824:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666738816:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213904:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666739328:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.213927:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.213958:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738304 00000100:00100000:0.0:1789135887.213965:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738304 00000100:00100000:0.0:1789135887.214386:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789135887.214398:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666738304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.214458:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666738304:12345-0@lo:400:kworker.0 Request processed in 63us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135887.214466:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789135887.214510:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666738304:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666738048:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215217:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.215239:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666738560:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.215280:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666739072:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.215331:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789135887.215338:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666738176:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.215373:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666738688:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.215425:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666739200:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.215478:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737920 00000100:00100000:2.0:1789135887.215483:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737920 00000100:00100000:2.0:1789135887.215515:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738432 00000100:00100000:2.0:1789135887.215518:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738432 00000100:00100000:2.0:1789135887.215553:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738944 00000100:00100000:2.0:1789135887.215557:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738944 00000100:00100000:2.0:1789135887.215587:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738560 00000100:00100000:2.0:1789135887.215591:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738560 00000100:00100000:2.0:1789135887.215604:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739072 00000100:00100000:2.0:1789135887.215607:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739072 00000100:00100000:2.0:1789135887.215619:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738176 00000100:00100000:2.0:1789135887.215622:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738176 00000100:00100000:2.0:1789135887.215634:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789135887.215641:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666737920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215691:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666737920:12345-0@lo:400:kworker.0 Request processed in 50us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.215698:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789135887.215715:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789135887.215722:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666738432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215750:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666738432:12345-0@lo:400:kworker.0 Request processed in 29us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.215757:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789135887.215769:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789135887.215774:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666738944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215802:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666738944:12345-0@lo:400:kworker.0 Request processed in 28us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.215814:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789135887.215827:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789135887.215833:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666738560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215891:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666738560:12345-0@lo:400:kworker.0 Request processed in 58us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.215897:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789135887.215910:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789135887.215917:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666739072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215943:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666739072:12345-0@lo:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.215949:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789135887.215961:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789135887.215967:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666738176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.215994:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666738176:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.216000:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789135887.216033:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738816 00000100:00100000:2.0:1789135887.216036:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738816 00000100:00100000:2.0:1789135887.216056:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739328 00000100:00100000:2.0:1789135887.216059:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739328 00000100:00100000:2.0:1789135887.216070:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738688 00000100:00100000:2.0:1789135887.216072:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738688 00000100:00100000:2.0:1789135887.216083:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739200 00000100:00100000:2.0:1789135887.216085:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739200 00000100:00100000:2.0:1789135887.216098:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789135887.216104:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666738816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216145:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666738816:12345-0@lo:400:kworker.0 Request processed in 41us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.216152:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789135887.216164:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789135887.216170:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666739328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216198:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666739328:12345-0@lo:400:kworker.0 Request processed in 28us (2269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.216203:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789135887.216214:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789135887.216220:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666738688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216262:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666738688:12345-0@lo:400:kworker.0 Request processed in 43us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.216268:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789135887.216279:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789135887.216284:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666739200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216310:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666739200:12345-0@lo:400:kworker.0 Request processed in 27us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.216315:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1789135887.216349:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe1e00 x1876044666738816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135887.216363:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666738816:0@lo:400:kworker.0 00010000:00080000:2.0:1789135887.216374:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ce9680 x1876044666739328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135887.216382:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666739328:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216402:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666737920:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216413:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666738432:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216422:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666738944:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.216458:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666738176:0@lo:400:kworker.0 00010000:00080000:2.0:1789135887.216467:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe12c0 x1876044666738688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135887.216475:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666738688:0@lo:400:kworker.0 00010000:00080000:2.0:1789135887.216483:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ceb0c0 x1876044666739200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135887.216490:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666739200:0@lo:400:kworker.0 00010000:00080000:2.0:1789135887.216499:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe0000 x1876044666738560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135887.216506:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666738560:0@lo:400:kworker.0 00010000:00080000:2.0:1789135887.216514:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ce8f00 x1876044666739072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135887.216521:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666739072:0@lo:400:kworker.0 00000100:00080000:3.0:1789135887.216837:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135887.216843:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135887.216846:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135887.216848:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135887.218177:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666738048 00000100:00100000:0.0:1789135887.218185:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666738048 00000100:00100000:0.0:1789135887.218232:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789135887.218240:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666738048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.218325:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666738048:12345-0@lo:400:kworker.0 Request processed in 85us (3107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135887.218332:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789135887.218355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666737792 00000100:00100000:0.0:1789135887.218358:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666737792 00000100:00100000:0.0:1789135887.218378:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789135887.218383:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666737792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.218414:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666737792:12345-0@lo:400:kworker.0 Request processed in 31us (4663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135887.218420:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789135887.220942:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666738048:0@lo:400:kworker.0 00000100:00100000:2.0:1789135887.221578:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666737792:0@lo:400:kworker.0 00000100:00100000:0.0:1789135887.224019:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135887.224042:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666739456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135887.224120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135887.224165:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739456 00000100:00100000:0.0:1789135887.224171:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739456 00000100:00100000:0.0:1789135887.224214:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789135887.224223:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666739456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135887.224252:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135887.224293:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666739456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135887.224314:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1789135887.224356:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671de00 x1876044666739456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135887.224374:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666739456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135887.225468:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666739584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135887.225519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.226989:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739584 00000100:00100000:2.0:1789135887.226998:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739584 00000100:00100000:2.0:1789135887.227066:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789135887.227077:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666739584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135887.227113:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135887.227186:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666739584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.227195:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789135887.227351:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e940 x1876044666739584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135887.227372:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666739584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135887.597264:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135887.721056:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135887.721082:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666739712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135887.721152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135887.721368:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739712 00000100:00100000:2.0:1789135887.721376:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739712 00000100:00100000:2.0:1789135887.721429:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789135887.721439:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666739712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135887.721473:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135887.721557:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666739712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.721565:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789135887.722280:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135887.722296:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666739840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135887.722335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789135887.722479:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a4000 x1876044666739712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135887.722499:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666739712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135887.723051:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739840 00000100:00100000:2.0:1789135887.723058:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739840 00000100:00100000:2.0:1789135887.723108:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789135887.723117:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666739840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135887.723135:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135887.723195:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666739840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135887.723201:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789135887.723329:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e940 x1876044666739840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135887.723363:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666739840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135888.232258:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666739968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135888.232373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135888.232468:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666739968 00000100:00100000:0.0:1789135888.232475:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666739968 00000100:00100000:0.0:1789135888.232544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789135888.232555:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666739968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789135888.232598:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789135888.234680:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666739968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2114us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135888.234707:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789135888.236435:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666739968:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135888.616200:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135888.891707:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135888.891752:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135888.891785:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135888.891811:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135888.891886:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135888.891916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633856 00000100:00100000:0.0:1789135888.891927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633856 00000100:00100000:0.0:1789135888.891981:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634112 00000100:00100000:0.0:1789135888.891985:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634112 00000100:00100000:0.0:1789135888.891999:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633728 00000100:00100000:0.0:1789135888.892001:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633728 00000100:00100000:0.0:1789135888.892012:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633984 00000100:00100000:0.0:1789135888.892014:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633984 00000100:00100000:0.0:1789135888.892030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:0.0:1789135888.892040:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644633856:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135888.892129:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644633856:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135888.892137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:0.0:1789135888.892156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:0.0:1789135888.892163:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644634112:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135888.892187:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644634112:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135888.892193:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:0.0:1789135888.892206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:0.0:1789135888.892213:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644633728:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135888.892251:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644633728:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 40us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135888.892258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:0.0:1789135888.892281:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00100000:0.0:1789135888.892288:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644633984:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135888.892310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644633984:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135888.892523:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00080000:0.0:1789135888.892543:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135888.892548:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135888.892970:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644633600 00000100:00100000:1.0:1789135888.892977:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644633600 00000100:00100000:1.0:1789135888.893019:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 320 00000100:00100000:1.0:1789135888.893026:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644633600:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135888.893066:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644633600:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 41us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135888.893073:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 320 00010000:00010000:2.0:1789135889.640344:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789135890.602410:0:13038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789135890.664971:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135891.688109:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135891.815998:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135891.816302:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666740096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135891.816380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135891.816457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740096 00000100:00100000:1.0:1789135891.816480:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740096 00000100:00100000:1.0:1789135891.816544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789135891.816554:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666740096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135891.816596:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135891.816656:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666740096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135891.816665:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789135891.817100:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666740096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135892.330972:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135892.331069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.331170:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740224 00000100:00100000:0.0:1789135892.331180:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740224 00000100:00100000:0.0:1789135892.331240:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789135892.331250:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666740224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135892.331300:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135892.331347:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666740224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.331355:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1789135892.331381:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135892.331572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666740352:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.331610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.331638:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666740864:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.331810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.331832:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666741376:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.331888:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.331913:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789135892.331920:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666740480:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.331943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.331962:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666740992:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.331984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.332002:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666741504:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.332024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.332060:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740352 00000100:00100000:0.0:1789135892.332066:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740352 00000100:00100000:0.0:1789135892.332104:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789135892.332111:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666740352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.332148:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666740352:12345-0@lo:400:kworker.0 Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.332155:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789135892.332187:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740864 00000100:00100000:0.0:1789135892.332191:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740864 00000100:00100000:0.0:1789135892.332218:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789135892.332224:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666740864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.332257:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666740864:12345-0@lo:400:kworker.0 Request processed in 34us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.332264:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789135892.332281:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741376 00000100:00100000:0.0:1789135892.332285:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741376 00000100:00100000:0.0:1789135892.332324:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740480 00000100:00100000:0.0:1789135892.332327:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740480 00000100:00100000:0.0:1789135892.332338:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740992 00000100:00100000:0.0:1789135892.332341:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740992 00000100:00100000:0.0:1789135892.332357:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741504 00000100:00100000:0.0:1789135892.332360:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741504 00000100:00100000:0.0:1789135892.332373:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789135892.332378:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666741376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.332410:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666741376:12345-0@lo:400:kworker.0 Request processed in 31us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.334837:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789135892.334914:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789135892.334936:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666740480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.335071:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666740480:12345-0@lo:400:kworker.0 Request processed in 148us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.335077:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789135892.335089:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789135892.335099:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666740992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.335131:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666740992:12345-0@lo:400:kworker.0 Request processed in 35us (3147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.335137:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789135892.335148:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789135892.335156:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666741504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.335190:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666741504:12345-0@lo:400:kworker.0 Request processed in 35us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.335197:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789135892.336490:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135892.336519:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666741888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135892.336592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789135892.336649:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135892.336657:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135892.338633:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741888 00000100:00100000:0.0:1789135892.338673:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741888 00000100:00100000:0.0:1789135892.338761:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789135892.338771:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666741888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135892.338808:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135892.338918:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666741888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.338925:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789135892.338976:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3b8e940 x1876044666741888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.339001:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3b8e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666741888:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789135892.339034:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135892.339153:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666740480:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339169:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666740992:0@lo:400:kworker.0 00010000:00080000:2.0:1789135892.339183:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e81680 x1876044666741504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135892.339192:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666741504:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339204:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666740352:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339217:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666740864:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339229:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666741376:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339284:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666740608:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135892.339369:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666741120:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.339397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135892.357518:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666741632:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.357622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135892.357660:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789135892.357681:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666740736:0@lo:400:kworker.0 00000100:00100000:2.0:1789135892.357711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135892.357945:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741632 00000100:00100000:3.0:1789135892.357956:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741632 00000100:00100000:3.0:1789135892.358031:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789135892.358044:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666741632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135892.358112:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666741632:12345-0@lo:400:kworker.0 Request processed in 72us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135892.358120:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789135892.358184:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe0f00 x1876044666740224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135892.358221:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666740224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135892.363590:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741120 00000100:00100000:1.0:1789135892.363613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741120 00000100:00100000:1.0:1789135892.363661:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740608 00000100:00100000:1.0:1789135892.363665:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740608 00000100:00100000:1.0:1789135892.366477:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135892.366494:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666740608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135892.366620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666740608:12345-0@lo:400:kworker.0 Request processed in 128us (27291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.366628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135892.367799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789135892.367810:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666741120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135892.367902:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666741120:12345-0@lo:400:kworker.0 Request processed in 93us (28504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.367909:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1789135892.372038:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135892.372053:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135892.376919:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666741248:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.377019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.377048:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666741760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.377068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.377098:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741248 00000100:00100000:0.0:1789135892.377108:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741248 00000100:00100000:0.0:1789135892.377169:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666741760 00000100:00100000:0.0:1789135892.377171:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666741760 00000100:00100000:0.0:1789135892.377207:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789135892.377229:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666741248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.377300:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66efc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666741248:12345-0@lo:400:kworker.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.377308:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789135892.377326:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789135892.377346:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666741760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.377371:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666741760:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.377377:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789135892.377403:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789135892.377658:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66eda40 x1876044666741760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.377734:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666741760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135892.377757:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666740608:0@lo:400:kworker.0 00010000:00080000:0.0:1789135892.377771:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82940 x1876044666741120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.377780:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666741120:0@lo:400:kworker.0 00010000:00080000:0.0:1789135892.377794:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80000 x1876044666741632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.377802:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666741632:0@lo:400:kworker.0 00010000:00080000:0.0:1789135892.377836:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82580 x1876044666741248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.377844:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666741248:0@lo:400:kworker.0 00000100:00100000:1.0:1789135892.381098:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666740736 00000100:00100000:1.0:1789135892.381120:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666740736 00000100:00100000:1.0:1789135892.382338:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789135892.382361:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666740736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135892.382533:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666740736:12345-0@lo:400:kworker.0 Request processed in 182us (24820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.382553:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789135892.382966:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666740736:0@lo:400:kworker.0 00010000:00010000:1.0:1789135892.716081:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135892.844156:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666742016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135892.844282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135892.844390:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742016 00000100:00100000:0.0:1789135892.844399:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742016 00000100:00100000:0.0:1789135892.844695:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789135892.844722:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666742016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135892.844765:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135892.844820:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666742016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135892.844828:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1789135892.845191:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66eda40 x1876044666742016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135892.845218:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666742016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135892.846082:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135892.846105:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666742144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135892.846170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135892.846402:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742144 00000100:00100000:1.0:1789135892.846418:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742144 00000100:00100000:1.0:1789135892.846505:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789135892.846516:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666742144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135892.846538:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135892.846590:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666742144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135892.846597:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789135892.846636:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e9e00 x1876044666742144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135892.846652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666742144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135893.352097:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135893.352122:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666742272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135893.352195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135893.352401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742272 00000100:00100000:1.0:1789135893.352409:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742272 00000100:00100000:1.0:1789135893.352478:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789135893.352489:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666742272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135893.352525:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135893.352577:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666742272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135893.352585:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789135893.352631:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666742272:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135893.743315:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135894.010584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135894.010631:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135894.010674:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135894.010702:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135894.010749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135894.010782:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634240 00000100:00100000:0.0:1789135894.010794:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634240 00000100:00100000:0.0:1789135894.010881:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 322 00000100:00100000:0.0:1789135894.010893:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644634240:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135894.010991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644634240:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 100us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135894.011000:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 322 00000100:00100000:0.0:1789135894.011043:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634368 00000100:00100000:0.0:1789135894.011047:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634368 00000100:00100000:0.0:1789135894.011083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634624 00000100:00100000:0.0:1789135894.011086:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634624 00000100:00100000:0.0:1789135894.011100:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634496 00000100:00100000:0.0:1789135894.011102:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634496 00000100:00100000:0.0:1789135894.011114:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634752 00000100:00100000:0.0:1789135894.011123:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634752 00000100:00100000:0.0:1789135894.011767:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:0.0:1789135894.011777:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644634368:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135894.011822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644634368:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 48us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135894.011829:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:0.0:1789135894.011844:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 222 00000100:00100000:0.0:1789135894.011850:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644634624:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135894.011905:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644634624:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 54us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135894.011911:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 222 00000100:00100000:0.0:1789135894.011924:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:0.0:1789135894.011931:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644634496:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135894.011952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644634496:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135894.011959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:0.0:1789135894.011970:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 224 00000100:00100000:0.0:1789135894.011976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644634752:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135894.011997:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644634752:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135894.012004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 224 00000100:00080000:0.0:1789135894.013219:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135894.013225:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135894.760078:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135895.785344:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789135895.801524:0:13186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf0e84960 20000000:00000080:3.0:1789135895.801551:0:13186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7f6627000 uarg=0000000000000000 20000000:01000000:3.0:1789135895.801609:0:13186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789135895.801617:0:13186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789135895.801624:0:13186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789135895.802812:0:13187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789135895.803395:0:13186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789135895.812019:0:13186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789135895.812064:0:13186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812091:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812101:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812108:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812115:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812122:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812130:0:13186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812138:0:13186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812209:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812230:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 12 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.812276:0:13186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742400:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135895.812453:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812461:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 23 pid: 6508 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.812471:0:13186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742528:0@lo:104: 00000100:00100000:3.0:1789135895.812526:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135895.812582:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812590:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 23 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.812599:0:13186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742656:0@lo:104: 00000100:00100000:3.0:1789135895.812654:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135895.812681:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812690:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 23 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.812699:0:13186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742784:0@lo:104: 00000100:00100000:3.0:1789135895.812720:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135895.812746:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812766:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 23 pid: 6510 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.812775:0:13186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742912:0@lo:104: 00000100:00100000:3.0:1789135895.812799:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135895.812819:0:13186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135895.812828:0:13186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.812837:0:13186:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666743040:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135895.813120:0:13186:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135895.813340:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742528 00000100:00100000:2.0:1789135895.813352:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742528 00000100:00100000:2.0:1789135895.813422:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742656 00000100:00100000:2.0:1789135895.813426:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742656 00000100:00100000:2.0:1789135895.813438:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742784 00000100:00100000:2.0:1789135895.813441:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742784 00000100:00100000:2.0:1789135895.813450:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666742912 00000100:00100000:2.0:1789135895.813453:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666742912 00000100:00100000:2.0:1789135895.813469:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135895.813479:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:13186:x1876044666742528:12345-0@lo:104: 00010000:00010000:2.0:1789135895.813497:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.813570:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135895.813577:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+6:13186:x1876044666742528:12345-0@lo:104: Request processed in 100us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.813586:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789135895.813616:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135895.813622:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:13186:x1876044666742656:12345-0@lo:104: 00010000:00010000:2.0:1789135895.813630:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.813656:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789135895.813669:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:13186:x1876044666742656:12345-0@lo:104: Request processed in 48us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.813675:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789135895.813686:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135895.813691:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13186:x1876044666742784:12345-0@lo:104: 00010000:00010000:2.0:1789135895.813699:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.813723:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789135895.813728:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13186:x1876044666742784:12345-0@lo:104: Request processed in 37us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.813734:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789135895.813743:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789135895.813748:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13186:x1876044666742912:12345-0@lo:104: 00010000:00010000:2.0:1789135895.813755:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135895.813780:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789135895.813785:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13186:x1876044666742912:12345-0@lo:104: Request processed in 37us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135895.813790:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789135895.815180:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789135895.815202:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815211:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135895.815216:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815227:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135895.815235:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135895.815242:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135895.815294:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815302:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135895.815333:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815342:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879400/0x559c8745c6de2a9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2aa2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815359:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789135895.815362:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815369:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031a00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135895.815382:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815400:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135895.815407:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135895.815413:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135895.815429:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815434:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135895.815439:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815446:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031a00/0x559c8745c6de2a8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a94 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815457:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135895.815461:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815467:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030a00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135895.815470:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815477:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135895.815484:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135895.815495:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135895.815509:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815515:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135895.815534:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815541:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0030a00/0x559c8745c6de2a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a86 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815552:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135895.815555:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815561:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135895.815564:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815571:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135895.815577:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135895.815582:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135895.815591:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815596:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135895.815611:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815618:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2a71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2a78 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.815632:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135895.815634:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135895.815635:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135895.815653:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666743168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.815711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135895.815769:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135895.815775:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666743296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.815796:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135895.815824:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666743424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.815843:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135895.815897:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135895.815902:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666743552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.815923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135895.815956:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743168 00000100:00100000:1.0:1789135895.815964:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743168 00010000:00010000:1.0:1789135895.815996:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 24 pid: 6508 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.816017:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743296 00000100:00100000:1.0:1789135895.816019:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743296 00010000:00010000:1.0:1789135895.816029:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 25 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.816039:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743424 00000100:00100000:1.0:1789135895.816048:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743424 00010000:00010000:1.0:1789135895.816061:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 26 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.816072:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743552 00000100:00100000:1.0:1789135895.816074:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743552 00010000:00010000:1.0:1789135895.816085:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 27 pid: 6510 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.816099:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135895.816106:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+27:3638:x1876044666743168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.816121:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.816127:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 27 pid: 6508 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816137:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 27 pid: 6508 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816160:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.816194:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+27:3638:x1876044666743168:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.816201:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789135895.816224:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135895.816230:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3638:x1876044666743296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.816238:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.816242:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 26 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816251:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 26 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816272:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.816295:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3638:x1876044666743296:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.816303:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135895.816316:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789135895.816322:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3640:x1876044666743424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.816330:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.816335:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 25 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816343:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 25 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816352:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.816389:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3640:x1876044666743424:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.816395:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789135895.816410:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135895.816416:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666743552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.816424:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.816428:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 24 pid: 6510 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816437:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 24 pid: 6510 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.816446:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.816474:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666743552:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.816481:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789135895.816512:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135895.816545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666743552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.816555:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666743424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.816584:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666743296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135895.816591:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666743168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135895.817670:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94ce00/0x559c8745c6de2aa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2a9b expref: 23 pid: 6508 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.817691:0:13186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742528:0@lo:104: 00010000:00010000:3.0:1789135895.817708:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2a94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2a8d expref: 22 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.817717:0:13186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742656:0@lo:104: 00010000:00010000:3.0:1789135895.817728:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2a86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2a7f expref: 21 pid: 6509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.817737:0:13186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b30c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742784:0@lo:104: 00010000:00010000:3.0:1789135895.817748:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2a71 expref: 20 pid: 6510 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135895.817775:0:13186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742912:0@lo:104: 00000100:00100000:3.0:1789135895.824107:0:13186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666742400:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135895.824172:0:13186:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13186:1876044666743040:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135895.824225:0:13186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135895.824356:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135895.824725:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644634880 00000100:00100000:1.0:1789135895.824733:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644634880 00010000:00010000:1.0:1789135895.824783:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 13 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.824833:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1789135895.824844:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644634880:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.824887:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.824895:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 13 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.824908:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 13 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.824931:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94d000/0x559c8745c6de2ab7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08881 expref: 13 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.824946:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.825024:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+12:2391:x1876044644634880:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 180us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.825032:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:0.0:1789135895.825182:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135895.825410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635008 00000100:00100000:1.0:1789135895.825417:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635008 00010000:00010000:1.0:1789135895.825445:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135895.825474:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:1.0:1789135895.825481:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f56ac69e-f262-403a-94d3-403db5052814+12:2391:x1876044644635008:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135895.825490:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135895.825495:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825504:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825516:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2a6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08842 expref: 12 pid: 6508 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825532:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825542:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825558:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825566:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825582:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825589:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825595:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135895.825599:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825608:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825765:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135895.825780:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135895.825821:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f56ac69e-f262-403a-94d3-403db5052814+11:2391:x1876044644635008:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 340us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135895.825829:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00010000:00010000:0.0:1789135895.827940:0:13186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.827961:0:13186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135895.827969:0:13186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2ada lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135896.808085:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135896.941334:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135896.941372:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666743680:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135896.941449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135896.941514:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743680 00000100:00100000:0.0:1789135896.941522:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743680 00000100:00100000:0.0:1789135896.941565:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789135896.941573:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666743680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135896.941610:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135896.941659:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666743680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135896.941666:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789135896.941714:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666743680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135897.147695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135897.151117:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635136 00000100:00100000:3.0:1789135897.151134:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635136 00000100:00100000:3.0:1789135897.151355:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 323 00000100:00100000:3.0:1789135897.151368:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:6167:x1876044644635136:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135897.151386:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135897.151405:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088b2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.151434:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.151446:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.151457:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f200, rc 0) 00000100:00100000:3.0:1789135897.151674:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644635136:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 307us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.151682:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 323 00000100:00100000:2.0:1789135897.155527:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135897.155641:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635264 00000100:00100000:1.0:1789135897.155651:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635264 00000100:00100000:1.0:1789135897.155746:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 324 00000100:00100000:1.0:1789135897.155755:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644635264:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.157680:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644635264:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 1918us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.157704:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 324 00000100:00100000:0.0:1789135897.169565:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135897.169878:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635392 00000100:00100000:2.0:1789135897.169889:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635392 00000100:00100000:2.0:1789135897.169954:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 325 00000100:00100000:2.0:1789135897.169966:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644635392:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.170124:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644635392:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 160us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.170140:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 325 00000100:00100000:1.0:1789135897.191236:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135897.194162:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635520 00000100:00100000:3.0:1789135897.194177:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635520 00000100:00100000:3.0:1789135897.194297:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 326 00000100:00100000:3.0:1789135897.194309:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644635520:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135897.194328:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135897.194357:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088b9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.194385:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.194397:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.194406:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ee00, rc 0) 00000100:00100000:3.0:1789135897.194478:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644635520:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 171us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.194485:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 326 00000100:00100000:0.0:1789135897.201968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135897.202118:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635648 00000100:00100000:2.0:1789135897.202128:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635648 00000100:00100000:2.0:1789135897.202190:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 327 00000100:00100000:2.0:1789135897.202201:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644635648:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.202371:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644635648:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 171us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.202379:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 327 00000100:00100000:1.0:1789135897.205871:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135897.205909:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635776 00000100:00100000:1.0:1789135897.205918:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635776 00000100:00100000:1.0:1789135897.205969:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 328 00000100:00100000:1.0:1789135897.205990:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644635776:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.206125:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644635776:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 137us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.206134:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 328 00000100:00100000:3.0:1789135897.452398:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666743808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135897.452549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.452734:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743808 00000100:00100000:2.0:1789135897.452743:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743808 00000100:00100000:2.0:1789135897.452903:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135897.452916:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666743808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135897.452946:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135897.452994:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666743808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.453001:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789135897.453072:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135897.455260:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82580 x1876044666743808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.455294:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666743808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135897.458538:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666744064:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.458624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.458675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666744576:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.458700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.458738:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666745088:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.458766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.458792:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789135897.458798:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666743936:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.459728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.459769:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666744448:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.459794:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.459910:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666744960:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.459947:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.459985:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666744192:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.460010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.460022:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666744704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.460045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.460066:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666745216:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.460086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.460109:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789135897.461075:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666744320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.461247:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666744832:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.461305:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744064 00000100:00100000:3.0:1789135897.461314:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744064 00000100:00100000:3.0:1789135897.461366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744576 00000100:00100000:3.0:1789135897.461369:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744576 00000100:00100000:3.0:1789135897.461394:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744448 00000100:00100000:3.0:1789135897.461397:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744448 00000100:00100000:3.0:1789135897.461428:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744960 00000100:00100000:3.0:1789135897.461432:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744960 00000100:00100000:3.0:1789135897.461443:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744192 00000100:00100000:3.0:1789135897.461445:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744192 00000100:00100000:3.0:1789135897.461454:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744832 00000100:00100000:3.0:1789135897.461456:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744832 00000100:00100000:3.0:1789135897.461471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789135897.461478:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666744064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461535:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666744064:12345-0@lo:400:kworker.0 Request processed in 56us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789135897.461558:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789135897.461563:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666744576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461605:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666744576:12345-0@lo:400:kworker.0 Request processed in 42us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461611:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789135897.461622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789135897.461627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666744448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666744448:12345-0@lo:400:kworker.0 Request processed in 29us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461663:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789135897.461675:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789135897.461681:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666744960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461708:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666744960:12345-0@lo:400:kworker.0 Request processed in 27us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789135897.461723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789135897.461736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666744192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461770:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666744192:12345-0@lo:400:kworker.0 Request processed in 35us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461775:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789135897.461788:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789135897.461793:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666744832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461833:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666744832:12345-0@lo:400:kworker.0 Request processed in 40us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789135897.461892:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745088 00000100:00100000:3.0:1789135897.461896:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745088 00000100:00100000:3.0:1789135897.461922:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744704 00000100:00100000:3.0:1789135897.461925:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744704 00000100:00100000:3.0:1789135897.461939:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745216 00000100:00100000:3.0:1789135897.461942:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745216 00000100:00100000:3.0:1789135897.461955:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135897.461961:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666745088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.461992:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666745088:12345-0@lo:400:kworker.0 Request processed in 32us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.461998:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789135897.462010:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789135897.462015:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666744704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.462044:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666744704:12345-0@lo:400:kworker.0 Request processed in 30us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.462050:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789135897.462060:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789135897.462066:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666745216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.462099:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666745216:12345-0@lo:400:kworker.0 Request processed in 33us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.462104:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789135897.462817:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666744320 00000100:00100000:0.0:1789135897.462823:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666744320 00000100:00100000:0.0:1789135897.462874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789135897.462880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666744320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135897.462933:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666744320:12345-0@lo:400:kworker.0 Request processed in 54us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.462940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789135897.467145:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666743936 00000100:00100000:3.0:1789135897.467159:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666743936 00000100:00100000:3.0:1789135897.467220:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789135897.467231:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666743936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.467317:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666743936:12345-0@lo:400:kworker.0 Request processed in 88us (7591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.467326:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00080000:3.0:1789135897.467395:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135897.467401:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135897.467404:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135897.467408:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135897.467445:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666744320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.468730:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666744832:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.468762:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666744192:0@lo:400:kworker.0 00010000:00080000:3.0:1789135897.468780:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b0000 x1876044666744704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.468791:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666744704:0@lo:400:kworker.0 00010000:00080000:3.0:1789135897.470019:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b1e00 x1876044666745216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.470036:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666745216:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.470339:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666743936:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.470386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666744448:0@lo:400:kworker.0 00010000:00080000:3.0:1789135897.470400:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b1680 x1876044666744960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.470410:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666744960:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.470422:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666744064:0@lo:400:kworker.0 00010000:00080000:3.0:1789135897.470433:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b12c0 x1876044666744576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.470441:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666744576:0@lo:400:kworker.0 00010000:00080000:3.0:1789135897.470453:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b2d00 x1876044666745088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.470472:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666745088:0@lo:400:kworker.0 00000100:00100000:3.0:1789135897.471767:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666745344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135897.471850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.471977:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745344 00000100:00100000:2.0:1789135897.471984:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745344 00000100:00100000:2.0:1789135897.472037:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789135897.472048:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666745344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135897.472070:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135897.472130:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666745344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.472138:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1789135897.472311:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80000 x1876044666745344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.472330:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666745344:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789135897.832041:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789135897.832107:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135897.832133:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c2291000 from 7 10000000:01000000:2.0:1789135897.832138:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135897.832185:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.832198:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.832209:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.832235:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.832333:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.832465:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.836241:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745472 00000100:00100000:0.0:1789135897.836256:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745472 00000100:00100000:0.0:1789135897.836349:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789135897.836361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666745472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135897.836383:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135897.836741:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2aef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.836774:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2aef expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.837221:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2aef expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.837232:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031a00, rc 0) 00000100:00100000:0.0:1789135897.838000:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666745472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1636us (5663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.838010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789135897.842548:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135897.842634:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.842643:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135897.842950:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.843016:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135897.843121:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6f51600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.846435:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745600 00000100:00100000:0.0:1789135897.846450:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745600 00000100:00100000:0.0:1789135897.846525:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789135897.846536:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666745600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.846726:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666745600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.846734:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789135897.846928:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.846980:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.847025:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135897.847067:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6f51600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.847072:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745728 00000100:00100000:0.0:1789135897.847076:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745728 00000100:00100000:0.0:1789135897.847108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789135897.847115:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666745728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.847197:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666745728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.847204:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789135897.847225:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789135897.848192:0:13242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789135897.848416:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789135897.848438:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135897.848453:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.848462:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135897.848469:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135897.848471:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7e761a000 from 7 10000000:01000000:2.0:1789135897.848472:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135897.848500:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.848505:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.848513:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.848534:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.848737:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.848782:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.848787:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745856 00000100:00100000:0.0:1789135897.848793:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745856 00000100:00100000:0.0:1789135897.848839:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789135897.848848:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666745856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135897.848879:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135897.848891:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2afd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.848912:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2afd expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.848923:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2afd expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.848931:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031600, rc 0) 00000100:00100000:0.0:1789135897.848990:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666745856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.848996:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789135897.849320:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135897.849344:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.849352:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135897.849491:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.849521:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.849556:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.849916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666745984 00000100:00100000:0.0:1789135897.849920:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666745984 00000100:00100000:0.0:1789135897.849951:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789135897.849958:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666745984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.850077:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666745984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135897.850082:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789135897.850189:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666745984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.850213:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.850241:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.850264:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135897.850281:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746112 00000100:00100000:1.0:1789135897.850285:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746112 00000100:00100000:1.0:1789135897.850319:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789135897.850326:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666746112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.850421:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666746112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.850428:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789135897.850492:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789135897.851424:0:13243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789135897.851730:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789135897.851759:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135897.851768:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.851779:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135897.851790:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135897.851792:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 7 10000000:01000000:1.0:1789135897.851794:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135897.851824:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.851832:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.851842:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135897.851993:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.852043:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135897.852114:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6f51240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135897.852148:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746240 00000100:00100000:2.0:1789135897.852153:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746240 00000100:00100000:2.0:1789135897.852217:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789135897.852226:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666746240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135897.852238:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135897.852255:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b0b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.852473:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.852484:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135897.852493:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94ca00, rc 0) 00000100:00100000:2.0:1789135897.852540:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666746240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 315us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135897.852547:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789135897.852724:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135897.852736:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.852743:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.852914:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.852943:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135897.852966:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6424240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135897.853038:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746368 00000100:00100000:1.0:1789135897.853042:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746368 00000100:00100000:1.0:1789135897.853075:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789135897.853083:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666746368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.853221:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666746368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.853229:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789135897.853437:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.853470:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135897.853507:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135897.853540:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d0e1a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135897.853641:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746496 00000100:00100000:0.0:1789135897.853645:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746496 00000100:00100000:1.0:1789135897.853742:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789135897.853751:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666746496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.853832:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666746496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.853840:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789135897.854018:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789135897.855957:0:13244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789135897.856246:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789135897.856270:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135897.856281:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.856293:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135897.856304:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135897.856306:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 7 10000000:01000000:0.0:1789135897.856309:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135897.856357:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.856374:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.856521:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.856548:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.856766:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135897.857048:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6424840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135897.857236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746624 00000100:00100000:1.0:1789135897.857243:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746624 00000100:00100000:1.0:1789135897.857290:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789135897.857300:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666746624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135897.857314:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135897.857331:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b19 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.857367:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.857399:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135897.857408:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135897.857462:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666746624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.857470:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789135897.857561:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135897.857586:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135897.857596:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135897.857656:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.857694:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135897.857714:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6424840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135897.858200:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746752 00000100:00100000:1.0:1789135897.858206:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746752 00000100:00100000:1.0:1789135897.858247:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789135897.858255:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666746752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.858406:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666746752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.858414:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789135897.858652:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.858761:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135897.859001:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135897.859076:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6424840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135897.859749:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666746880 00000100:00100000:1.0:1789135897.859755:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666746880 00000100:00100000:1.0:1789135897.860050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789135897.860059:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666746880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135897.860203:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666746880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.860211:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789135897.860297:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666746880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789135897.862257:0:13246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789135897.862358:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789135897.862380:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135897.862390:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135897.862401:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135897.960174:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135897.960202:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666747008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135897.960291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135897.961232:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747008 00000100:00100000:3.0:1789135897.961242:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747008 00000100:00100000:3.0:1789135897.961290:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789135897.961301:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666747008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135897.961363:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135897.961418:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666747008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135897.961425:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1789135897.961469:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fbfc00 x1876044666747008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135897.961489:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666747008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135897.962108:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666747136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135897.962149:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135897.962182:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747136 00000100:00100000:1.0:1789135897.962186:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747136 00000100:00100000:1.0:1789135897.962221:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789135897.962228:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666747136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135897.962242:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135897.962273:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666747136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135897.962279:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1789135897.962306:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b03480 x1876044666747136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135897.962319:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666747136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135898.476362:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135898.476391:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666747264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135898.476469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135898.476546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747264 00000100:00100000:3.0:1789135898.476555:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747264 00000100:00100000:3.0:1789135898.476602:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789135898.476612:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666747264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135898.476648:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135898.476696:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666747264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135898.476702:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789135898.476761:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666747264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789135898.856043:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135899.132033:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135899.132091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135899.132119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135899.132139:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135899.132159:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135899.132187:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644635904 00000100:00100000:3.0:1789135899.132197:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644635904 00000100:00100000:3.0:1789135899.132262:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 342 00000100:00100000:3.0:1789135899.132275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644635904:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135899.132363:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644635904:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135899.132370:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 342 00000100:00100000:3.0:1789135899.132404:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636032 00000100:00100000:3.0:1789135899.132408:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636032 00000100:00100000:3.0:1789135899.132438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636288 00000100:00100000:3.0:1789135899.132441:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636288 00000100:00100000:3.0:1789135899.132453:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636160 00000100:00100000:3.0:1789135899.132455:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636160 00000100:00100000:3.0:1789135899.132466:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636416 00000100:00100000:3.0:1789135899.132469:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636416 00000100:00100000:3.0:1789135899.132482:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:3.0:1789135899.132488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644636032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135899.132518:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644636032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135899.132524:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:3.0:1789135899.132536:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:3.0:1789135899.132559:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644636288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135899.132586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644636288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135899.132591:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:3.0:1789135899.132603:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:3.0:1789135899.132626:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644636160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135899.132650:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644636160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135899.132657:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:3.0:1789135899.132669:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 234 00000100:00100000:3.0:1789135899.132675:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644636416:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135899.132698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644636416:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135899.132704:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 234 00000100:00080000:3.0:1789135899.132831:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135899.132836:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135899.881333:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789135900.186255:0:13384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789135900.906382:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135901.939760:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135902.058040:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135902.058073:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666747392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135902.058161:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.058238:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747392 00000100:00100000:1.0:1789135902.058246:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747392 00000100:00100000:1.0:1789135902.058308:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789135902.058317:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666747392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135902.058364:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135902.058414:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666747392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.058422:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789135902.058473:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666747392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135902.568764:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666747648:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.568919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.568994:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666748160:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666748672:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569088:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569120:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789135902.569127:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666747520:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569172:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569197:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666748032:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569239:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666748544:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569299:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666747776:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569350:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666748288:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569407:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789135902.569414:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666747904:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569458:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666748416:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.569481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135902.569515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747648 00000100:00100000:1.0:1789135902.569526:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747648 00000100:00100000:1.0:1789135902.569574:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748160 00000100:00100000:1.0:1789135902.569577:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748160 00000100:00100000:1.0:1789135902.569618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748672 00000100:00100000:1.0:1789135902.569621:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748672 00000100:00100000:1.0:1789135902.572142:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748032 00000100:00100000:1.0:1789135902.572163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748032 00000100:00100000:1.0:1789135902.572191:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748544 00000100:00100000:1.0:1789135902.572194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748544 00000100:00100000:1.0:1789135902.572209:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747776 00000100:00100000:1.0:1789135902.572212:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747776 00000100:00100000:1.0:1789135902.572232:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789135902.572245:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666747648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.572428:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666747648:12345-0@lo:400:kworker.0 Request processed in 185us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.572436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789135902.572463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789135902.572471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666748160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.572506:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666748160:12345-0@lo:400:kworker.0 Request processed in 37us (3483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.572512:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789135902.572529:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789135902.572535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666748672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.572565:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666748672:12345-0@lo:400:kworker.0 Request processed in 31us (3477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.572573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789135902.572584:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789135902.572590:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666748032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.572617:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666748032:12345-0@lo:400:kworker.0 Request processed in 28us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.573026:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135902.573072:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666748800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135902.573128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135902.573180:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748800 00000100:00100000:0.0:1789135902.573186:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748800 00000100:00100000:0.0:1789135902.573232:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789135902.573239:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666748800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135902.573285:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135902.573329:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666748800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.573337:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:0.0:1789135902.573389:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44912c0 x1876044666748800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135902.573414:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666748800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135902.575822:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789135902.575909:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789135902.575927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666748544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576387:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666749056:0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135902.576502:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135902.576512:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666748928:0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576541:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135902.576578:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748288 00000100:00100000:0.0:1789135902.576589:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748288 00000100:00100000:0.0:1789135902.576657:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748416 00000100:00100000:0.0:1789135902.576661:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748416 00000100:00100000:0.0:1789135902.576675:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749056 00000100:00100000:0.0:1789135902.576677:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749056 00000100:00100000:0.0:1789135902.576692:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666748928 00000100:00100000:0.0:1789135902.576695:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666748928 00000100:00100000:0.0:1789135902.576711:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789135902.576718:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666748288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576778:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666748288:12345-0@lo:400:kworker.0 Request processed in 59us (7396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.576785:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789135902.576802:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789135902.576809:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666748416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576837:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666748416:12345-0@lo:400:kworker.0 Request processed in 29us (7355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.576843:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789135902.576880:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789135902.576886:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666749056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576916:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666749056:12345-0@lo:400:kworker.0 Request processed in 30us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.576921:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789135902.576931:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789135902.576937:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666748928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.576958:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666748928:12345-0@lo:400:kworker.0 Request processed in 21us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.576964:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1789135902.576998:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b1e00 x1876044666749056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135902.577015:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666749056:0@lo:400:kworker.0 00010000:00080000:0.0:1789135902.577066:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b30c0 x1876044666748928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135902.577076:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666748928:0@lo:400:kworker.0 00010000:00080000:0.0:1789135902.577096:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b03c0 x1876044666748416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135902.577105:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666748416:0@lo:400:kworker.0 00010000:00080000:0.0:1789135902.577114:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b12c0 x1876044666748288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135902.577122:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666748288:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.577352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666748544:12345-0@lo:400:kworker.0 Request processed in 130us (6772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.577364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789135902.577390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789135902.577400:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666747776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.577458:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666747776:12345-0@lo:400:kworker.0 Request processed in 61us (8121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.577465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789135902.577505:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747520 00000100:00100000:1.0:1789135902.577511:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747520 00000100:00100000:1.0:1789135902.577547:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789135902.577555:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666747520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.577592:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666747520:12345-0@lo:400:kworker.0 Request processed in 38us (8418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.577598:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789135902.578172:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666747776:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.578758:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666747904 00000100:00100000:1.0:1789135902.578766:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666747904 00000100:00100000:1.0:1789135902.578834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789135902.578844:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666747904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135902.579840:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135902.579889:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666749184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135902.579944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135902.579997:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749184 00000100:00100000:0.0:1789135902.580003:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749184 00000100:00100000:0.0:1789135902.580046:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789135902.580067:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666749184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135902.580090:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135902.580147:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666749184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135902.580156:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1789135902.580203:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83480 x1876044666749184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135902.580226:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666749184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135902.580318:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666747904:12345-0@lo:400:kworker.0 Request processed in 1475us (10874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135902.580328:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1789135902.580375:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135902.580381:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135902.580386:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135902.580389:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135902.580415:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666747520:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.580433:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666748032:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.580447:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666748544:0@lo:400:kworker.0 00000100:00100000:1.0:1789135902.580462:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666747648:0@lo:400:kworker.0 00010000:00080000:1.0:1789135902.580476:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b2d00 x1876044666748160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135902.580485:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666748160:0@lo:400:kworker.0 00010000:00080000:1.0:1789135902.580499:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b2580 x1876044666748672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135902.580506:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666748672:0@lo:400:kworker.0 00000100:00100000:3.0:1789135902.588307:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666747904:0@lo:400:kworker.0 00010000:00010000:1.0:1789135902.952467:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135903.080315:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135903.080351:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666749312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135903.080457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135903.081312:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749312 00000100:00100000:1.0:1789135903.081326:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749312 00000100:00100000:1.0:1789135903.081413:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789135903.081425:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666749312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135903.081468:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135903.081530:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666749312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135903.081538:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1789135903.081682:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2da4f00 x1876044666749312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135903.081706:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2da4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666749312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135903.092060:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135903.092095:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666749440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135903.092196:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135903.092425:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749440 00000100:00100000:1.0:1789135903.092455:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749440 00000100:00100000:1.0:1789135903.092530:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789135903.092543:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666749440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789135903.092580:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135903.092660:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666749440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135903.092669:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789135903.092828:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82940 x1876044666749440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135903.092851:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666749440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135903.594213:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135903.594268:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666749568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135903.594381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135903.594486:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749568 00000100:00100000:1.0:1789135903.594495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749568 00000100:00100000:1.0:1789135903.594554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135903.594564:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666749568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135903.594615:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135903.594673:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666749568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135903.594682:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135903.594749:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666749568:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135903.976726:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135904.240836:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135904.240934:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135904.240983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135904.241010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135904.241035:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135904.241083:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636544 00000100:00100000:3.0:1789135904.241096:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636544 00000100:00100000:3.0:1789135904.241164:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 344 00000100:00100000:3.0:1789135904.241177:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644636544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135904.241282:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644636544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135904.241291:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 344 00000100:00100000:3.0:1789135904.241333:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636672 00000100:00100000:3.0:1789135904.241336:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636672 00000100:00100000:3.0:1789135904.241372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636928 00000100:00100000:3.0:1789135904.241374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636928 00000100:00100000:3.0:1789135904.241386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644636800 00000100:00100000:3.0:1789135904.241388:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644636800 00000100:00100000:3.0:1789135904.241399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637056 00000100:00100000:3.0:1789135904.241401:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637056 00000100:00100000:3.0:1789135904.241414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 241 00000100:00100000:3.0:1789135904.241420:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644636672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135904.241453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644636672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135904.241459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 241 00000100:00100000:3.0:1789135904.241470:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 242 00000100:00100000:3.0:1789135904.241475:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644636928:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135904.241495:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644636928:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135904.241512:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 242 00000100:00100000:3.0:1789135904.241524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 243 00000100:00100000:3.0:1789135904.241530:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644636800:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135904.241555:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644636800:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135904.241561:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 243 00000100:00100000:3.0:1789135904.241571:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 244 00000100:00100000:3.0:1789135904.241577:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644637056:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135904.241598:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644637056:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135904.241605:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 244 00000100:00080000:3.0:1789135904.241777:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135904.241783:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135905.001176:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135906.024443:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135907.048017:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135907.176732:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666749696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135907.176836:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.179092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749696 00000100:00100000:1.0:1789135907.179114:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749696 00000100:00100000:1.0:1789135907.179217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135907.179230:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666749696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135907.179285:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135907.179394:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666749696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135907.179408:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135907.179487:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666749696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135907.688499:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666749824:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.688640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.688713:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666750336:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.688749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.688771:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666750848:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.688795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.688825:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789135907.688831:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666749952:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.688902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.688924:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666750464:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.688961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.688982:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666750976:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135907.689065:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749824 00000100:00100000:3.0:1789135907.689076:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749824 00000100:00100000:3.0:1789135907.689145:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789135907.689166:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666749824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689232:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666749824:12345-0@lo:400:kworker.0 Request processed in 77us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.689240:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789135907.689283:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750336 00000100:00100000:3.0:1789135907.689286:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750336 00000100:00100000:3.0:1789135907.689321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750848 00000100:00100000:3.0:1789135907.689324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750848 00000100:00100000:3.0:1789135907.689337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666749952 00000100:00100000:3.0:1789135907.689339:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666749952 00000100:00100000:3.0:1789135907.689349:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750464 00000100:00100000:3.0:1789135907.689351:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750464 00000100:00100000:3.0:1789135907.689362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750976 00000100:00100000:3.0:1789135907.689364:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750976 00000100:00100000:3.0:1789135907.689377:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789135907.689383:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666750336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689425:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666750336:12345-0@lo:400:kworker.0 Request processed in 42us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.689431:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789135907.689442:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789135907.689456:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666750848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689482:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666750848:12345-0@lo:400:kworker.0 Request processed in 28us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.689489:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789135907.689500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789135907.689505:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666749952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689528:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666749952:12345-0@lo:400:kworker.0 Request processed in 23us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.689534:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789135907.689545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789135907.689550:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666750464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689572:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666750464:12345-0@lo:400:kworker.0 Request processed in 22us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.689578:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789135907.689586:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789135907.689592:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666750976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689613:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666750976:12345-0@lo:400:kworker.0 Request processed in 23us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.689619:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1789135907.689656:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135907.689662:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135907.689696:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666749952:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.689712:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b5a40 x1876044666750464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.689723:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666750464:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.689741:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b43c0 x1876044666750976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.689750:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666750976:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689760:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666749824:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689771:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666750336:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.689780:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666750848:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690331:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666750080:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.690490:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666750592:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.690553:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666751104:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.690668:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135907.690677:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666750208:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.690731:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666750720:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.690770:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666751232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.690796:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135907.690843:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750592 00000100:00100000:1.0:1789135907.690849:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750592 00000100:00100000:1.0:1789135907.690925:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751104 00000100:00100000:0.0:1789135907.691423:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4491e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666751488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135907.691466:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135907.691493:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135907.691499:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4492d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666751360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135907.691523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135907.691581:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750720 00000100:00100000:0.0:1789135907.691587:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750720 00000100:00100000:0.0:1789135907.691625:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751232 00000100:00100000:0.0:1789135907.691629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751232 00000100:00100000:0.0:1789135907.691648:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789135907.691658:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666750592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135907.691715:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666750592:12345-0@lo:400:kworker.0 Request processed in 58us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.691723:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789135907.691744:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789135907.691750:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666750720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135907.691776:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666750720:12345-0@lo:400:kworker.0 Request processed in 27us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.691783:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789135907.691796:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789135907.691802:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666751232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135907.691830:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666751232:12345-0@lo:400:kworker.0 Request processed in 28us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.691883:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789135907.691906:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750208 00000100:00100000:0.0:1789135907.691910:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750208 00000100:00100000:0.0:1789135907.691955:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789135907.691964:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666750208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.692498:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751488 00000100:00100000:3.0:1789135907.692504:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751488 00000100:00100000:3.0:1789135907.692539:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751360 00000100:00100000:3.0:1789135907.692542:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751360 00000100:00100000:3.0:1789135907.692556:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789135907.692564:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666751488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135907.692593:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135907.693532:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789135907.693552:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666751360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135907.693572:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135907.693676:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666751360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135907.693685:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1789135907.693742:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4492d00 x1876044666751360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135907.693767:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4492d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666751360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135907.694332:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751104 00000100:00100000:3.0:1789135907.694580:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666751488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2014us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.694588:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789135907.694677:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789135907.694688:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666751104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135907.694738:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666751104:12345-0@lo:400:kworker.0 Request processed in 53us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135907.694746:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1789135907.695141:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135907.695148:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135907.695173:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666750080 00000100:00100000:3.0:1789135907.695183:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666750080 00000100:00100000:3.0:1789135907.695222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789135907.695229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666750080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.695271:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666750080:12345-0@lo:400:kworker.0 Request processed in 43us (4887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135907.695278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789135907.695520:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666750208:12345-0@lo:400:kworker.0 Request processed in 3554us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135907.695530:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:2.0:1789135907.696201:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4491e00 x1876044666751488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135907.696233:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4491e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666751488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135907.696872:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666750208:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.696898:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b7c00 x1876044666750720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.696909:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666750720:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.696924:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b7840 x1876044666751232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.696943:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666751232:0@lo:400:kworker.0 00000100:00100000:3.0:1789135907.696960:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666750080:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.696974:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b4780 x1876044666750592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.696984:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666750592:0@lo:400:kworker.0 00010000:00080000:3.0:1789135907.696997:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b7480 x1876044666751104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135907.697005:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666751104:0@lo:400:kworker.0 00010000:00010000:3.0:1789135908.085324:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135908.200169:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666751616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135908.200274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135908.200587:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751616 00000100:00100000:3.0:1789135908.200601:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751616 00000100:00100000:3.0:1789135908.200670:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789135908.200681:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666751616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135908.200723:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135908.200782:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666751616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135908.200791:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1789135908.201592:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b1680 x1876044666751616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135908.201621:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666751616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135908.202782:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135908.202806:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666751744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135908.202908:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.203551:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751744 00000100:00100000:1.0:1789135908.204059:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751744 00000100:00100000:1.0:1789135908.204133:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789135908.204145:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666751744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789135908.204190:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135908.204263:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666751744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135908.204272:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789135908.204336:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b4000 x1876044666751744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135908.204359:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666751744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135908.718154:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666751872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135908.718357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135908.718623:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666751872 00000100:00100000:3.0:1789135908.718636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666751872 00000100:00100000:3.0:1789135908.719081:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789135908.719094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666751872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135908.719155:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135908.719243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666751872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135908.719251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789135908.719350:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666751872:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1789135908.983095:0:13678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0f84ee80 20000000:00000080:2.0:1789135908.983120:0:13678:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a6c3fd9800 uarg=0000000000000000 20000000:01000000:2.0:1789135908.984668:0:13678:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789135908.984682:0:13678:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789135908.984690:0:13678:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789135908.985353:0:13679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789135908.985554:0:13678:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:2.0:1789135908.997627:0:13678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789135908.997675:0:13678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:2.0:1789135908.997686:0:13678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:2.0:1789135908.997702:0:13678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789135908.997728:0:13678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997751:0:13678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997758:0:13678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997785:0:13678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2aef expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997789:0:13678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2afd expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997793:0:13678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997797:0:13678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997801:0:13678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997845:0:13678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.997887:0:13678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 23 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135908.997907:0:13678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752000:0@lo:104: 00000100:00100000:2.0:1789135908.998001:0:13678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789135908.998087:0:13678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.998097:0:13678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 23 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135908.998104:0:13678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752128:0@lo:104: 00010000:00010000:2.0:1789135908.998143:0:13678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2afd expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.998152:0:13678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2afd expref: 23 pid: 6508 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135908.998162:0:13678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752256:0@lo:104: 00010000:00010000:2.0:1789135908.998196:0:13678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2aef expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.998204:0:13678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2aef expref: 23 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135908.998212:0:13678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752384:0@lo:104: 00010000:00010000:2.0:1789135908.998236:0:13678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.998247:0:13678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135908.998257:0:13678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752512:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135908.998339:0:13678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135908.998348:0:13678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 12 pid: 6509 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135908.998356:0:13678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752640:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135908.998380:0:13678:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135908.998800:0:10335:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789135908.998826:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.998892:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.998917:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135908.998929:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666752000 00000100:00100000:1.0:1789135908.998937:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666752000 00000100:00100000:1.0:1789135908.998989:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666752128 00000100:00100000:1.0:1789135908.999001:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666752128 00000100:00100000:1.0:1789135908.999017:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666752256 00000100:00100000:1.0:1789135908.999019:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666752256 00000100:00100000:1.0:1789135908.999027:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666752384 00000100:00100000:1.0:1789135908.999029:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666752384 00000100:00100000:1.0:1789135908.999042:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789135908.999052:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6627450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+6:13678:x1876044666752000:12345-0@lo:104: 00010000:00010000:1.0:1789135908.999071:0:10335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135909.000214:0:13678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752000:0@lo:104: 00010000:00010000:1.0:1789135909.002549:0:10335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135909.002575:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6627450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+6:13678:x1876044666752000:12345-0@lo:104: Request processed in 3515us (4565us total) trans 0 rc 0/0 00010000:00010000:3.0:1789135909.002578:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135909.002592:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135909.002592:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789135909.002602:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789135909.002607:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.002619:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135909.002626:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135909.002632:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135909.002707:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135909.002708:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1789135909.002713:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789135909.002724:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+5:13678:x1876044666752128:12345-0@lo:104: 00010000:00010000:1.0:1789135909.002737:0:10335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.002741:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.002762:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0030400/0x559c8745c6de2b19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b20 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.002781:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135909.002783:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135909.002784:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135909.002872:0:10335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135909.002878:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+5:13678:x1876044666752128:12345-0@lo:104: Request processed in 162us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135909.002884:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789135909.002900:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135909.002908:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13678:x1876044666752256:12345-0@lo:104: 00010000:00010000:1.0:1789135909.002916:0:10335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.002952:0:10335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789135909.002964:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13678:x1876044666752256:12345-0@lo:104: Request processed in 57us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135909.002970:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789135909.002986:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135909.002992:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13678:x1876044666752384:12345-0@lo:104: 00010000:00010000:1.0:1789135909.003001:0:10335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003031:0:10335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789135909.003036:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13678:x1876044666752384:12345-0@lo:104: Request processed in 45us (4119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135909.003041:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789135909.003069:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666752768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.003115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789135909.003170:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789135909.003175:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003183:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135909.003186:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003193:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135909.003199:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135909.003204:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135909.003231:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003237:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135909.003256:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003262:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003273:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789135909.003276:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003282:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94da00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135909.003285:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003292:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135909.003298:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135909.003303:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135909.003317:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003323:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789135909.003329:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003345:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ef94da00/0x559c8745c6de2afd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b04 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003356:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135909.003359:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003365:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789135909.003368:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.003376:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789135909.003383:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135909.003388:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789135909.003403:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135909.003739:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666752768 00000100:00100000:0.0:1789135909.003750:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666752768 00010000:00010000:0.0:1789135909.003790:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 24 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135909.004116:0:13678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752128:0@lo:104: 00000100:00100000:3.0:1789135909.004130:0:13678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752256:0@lo:104: 00000100:00100000:3.0:1789135909.004155:0:13678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752384:0@lo:104: 00000100:00100000:0.0:1789135909.005809:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:1.0:1789135909.005835:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789135909.005843:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666752768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135909.005899:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135909.005899:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135909.005914:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d800/0x559c8745c6de2aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2af6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135909.005916:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 24 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135909.005966:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 24 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.005972:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135909.005990:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b19 expref: 24 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.005999:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135909.006003:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135909.006055:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666752896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.006167:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135909.006241:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135909.006248:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666753024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.006271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135909.006307:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666752896 00000100:00100000:1.0:1789135909.006316:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666752896 00010000:00010000:1.0:1789135909.006351:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 25 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135909.006376:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753024 00000100:00100000:1.0:1789135909.006380:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753024 00010000:00010000:1.0:1789135909.006393:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2afd expref: 26 pid: 6508 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135909.008497:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135909.009123:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666753152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.009192:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789135909.009217:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3640:x1876044666752896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135909.009242:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135909.009253:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 25 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.009271:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 25 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.009296:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94ca00/0x559c8745c6de2b12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b0b expref: 25 pid: 6509 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.009311:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135909.009416:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666752896:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135909.009787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135909.010452:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666752768:12345-0@lo:103:ldlm_bl.0 Request processed in 3078us (5785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.011175:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135909.011201:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666753024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135909.011223:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135909.011235:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2afd expref: 24 pid: 6508 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.011251:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2afd expref: 24 pid: 6508 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.011272:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031600/0x559c8745c6de2b04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2afd expref: 24 pid: 6508 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.011293:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135909.011763:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3640:x1876044666753024:12345-0@lo:103:ldlm_bl.0 Request processed in 572us (5488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.011774:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789135909.011819:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1789135909.011829:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1789135909.012045:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135909.012099:0:13678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752512:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135909.014217:0:13678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13678:1876044666752640:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135909.014275:0:13678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135909.014367:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789135909.014436:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753152 00000100:00100000:1.0:1789135909.014445:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753152 00010000:00010000:1.0:1789135909.014674:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2aef expref: 22 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135909.014704:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789135909.014714:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3638:x1876044666753152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789135909.014735:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135909.014741:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2aef expref: 22 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.014759:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2aef expref: 22 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.014782:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de2af6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2aef expref: 22 pid: 6510 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.014802:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135909.014954:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666753152:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (5168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135909.014962:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789135909.014978:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666753152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.015039:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666752768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.015198:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666753024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.015208:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666752896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135909.016125:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135909.016202:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135909.016207:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637312 00000100:00100000:2.0:1789135909.016215:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637312 00010000:00010000:2.0:1789135909.016253:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 13 pid: 6509 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135909.016287:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637184 00000100:00100000:3.0:1789135909.016292:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637184 00010000:00010000:3.0:1789135909.016613:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 14 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135909.016673:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:3.0:1789135909.016683:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+14:2392:x1876044644637312:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135909.016699:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135909.016704:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 14 pid: 6509 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.016716:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 14 pid: 6509 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.016737:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2ae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b2 expref: 14 pid: 6509 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.016758:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135909.016822:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644637312:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 140us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.016830:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:3.0:1789135909.016850:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:3.0:1789135909.016955:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+12:2391:x1876044644637184:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135909.016965:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135909.016969:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.016994:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017005:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088b9 expref: 12 pid: 6508 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017019:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017029:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017050:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017058:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017066:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017073:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017080:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94de00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135909.017086:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017095:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017124:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135909.017147:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135909.017170:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+11:2391:x1876044644637184:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 218us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.017178:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:0.0:1789135909.018214:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1789135909.020632:0:13678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135909.020651:0:13678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135909.020660:0:13678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2b27 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135909.099604:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135909.360706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135909.363418:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637440 00000100:00100000:0.0:1789135909.363431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637440 00000100:00100000:0.0:1789135909.363516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 251 00000100:00100000:0.0:1789135909.363526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644637440:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135909.363611:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644637440:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 86us (2913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135909.363619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 251 00000100:00080000:1.0:1789135909.364025:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135909.378551:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135909.378583:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135909.378616:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135909.378645:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637568 00000100:00100000:3.0:1789135909.378654:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637568 00000100:00100000:3.0:1789135909.378712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637824 00000100:00100000:3.0:1789135909.378715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637824 00000100:00100000:3.0:1789135909.378728:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637696 00000100:00100000:3.0:1789135909.378731:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637696 00000100:00100000:3.0:1789135909.378748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 252 00000100:00100000:3.0:1789135909.378757:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644637568:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135909.378836:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644637568:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.378843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 252 00000100:00100000:3.0:1789135909.378886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 253 00000100:00100000:3.0:1789135909.378893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644637824:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135909.379776:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644637824:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 880us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.379800:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 253 00000100:00100000:3.0:1789135909.379823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 254 00000100:00100000:3.0:1789135909.379831:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644637696:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135909.379890:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644637696:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 60us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135909.379897:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 254 00000100:00080000:3.0:1789135909.380037:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135909.380041:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789135910.122134:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135910.322372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135910.322460:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644637952 00000100:00100000:3.0:1789135910.322471:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644637952 00000100:00100000:3.0:1789135910.322547:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 346 00000100:00100000:3.0:1789135910.322555:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:6167:x1876044644637952:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135910.322578:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135910.322594:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088c0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135910.322620:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135910.322628:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135910.322635:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e000, rc 0) 00000100:00100000:3.0:1789135910.322690:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644637952:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 136us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135910.322708:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 346 00000100:00100000:3.0:1789135910.327379:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135910.327502:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638080 00000100:00100000:0.0:1789135910.327513:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638080 00000100:00100000:0.0:1789135910.327589:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 347 00000100:00100000:0.0:1789135910.327602:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644638080:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.328697:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644638080:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 1091us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.328711:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 347 00000100:00100000:1.0:1789135910.332970:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135910.333062:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638208 00000100:00100000:3.0:1789135910.333072:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638208 00000100:00100000:3.0:1789135910.333139:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 348 00000100:00100000:3.0:1789135910.333150:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644638208:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135910.333322:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644638208:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 173us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135910.333331:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 348 00000100:00100000:0.0:1789135910.337666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135910.341936:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638336 00000100:00100000:1.0:1789135910.341953:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638336 00000100:00100000:1.0:1789135910.342033:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 349 00000100:00100000:1.0:1789135910.342046:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:10330:x1876044644638336:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135910.342236:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:10330:x1876044644638336:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 192us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.342245:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 349 00000100:00100000:0.0:1789135910.346930:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135910.349054:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638464 00000100:00100000:1.0:1789135910.349070:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638464 00000100:00100000:1.0:1789135910.349166:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 350 00000100:00100000:1.0:1789135910.349177:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:10330:x1876044644638464:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135910.349343:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:10330:x1876044644638464:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 167us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.349361:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 350 00000100:00100000:0.0:1789135910.352791:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135910.352911:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638592 00000100:00100000:1.0:1789135910.352923:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638592 00000100:00100000:1.0:1789135910.352989:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 351 00000100:00100000:1.0:1789135910.352998:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644638592:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135910.353014:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135910.353048:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088c7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.353079:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.353092:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.353101:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878800, rc 0) 00000100:00100000:1.0:1789135910.353177:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644638592:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 179us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.353184:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 351 00000100:00100000:0.0:1789135910.361319:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135910.361681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638720 00000100:00100000:3.0:1789135910.361691:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638720 00000100:00100000:3.0:1789135910.361750:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 352 00000100:00100000:3.0:1789135910.361760:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644638720:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135910.362088:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644638720:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 329us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135910.362096:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 352 00000100:00100000:3.0:1789135910.382057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135910.382260:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638848 00000100:00100000:0.0:1789135910.383071:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638848 00000100:00100000:0.0:1789135910.383146:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 353 00000100:00100000:0.0:1789135910.383156:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644638848:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135910.383553:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644638848:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 396us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.383561:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 353 00000100:00100000:0.0:1789135910.397952:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135910.399226:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644638976 00000100:00100000:1.0:1789135910.399240:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644638976 00000100:00100000:1.0:1789135910.399317:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 354 00000100:00100000:1.0:1789135910.399330:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:10334:x1876044644638976:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135910.399499:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:10334:x1876044644638976:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 172us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.399509:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 354 00000100:00100000:1.0:1789135910.422703:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135910.422850:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639104 00000100:00100000:0.0:1789135910.422901:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639104 00000100:00100000:0.0:1789135910.423024:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 355 00000100:00100000:0.0:1789135910.423036:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:10334:x1876044644639104:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135910.423213:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:10334:x1876044644639104:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 179us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.423222:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 355 10000000:01000000:3.0:1789135910.761345:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135910.761354:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c2291000 from 7 10000000:01000000:3.0:1789135910.761359:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135910.761415:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135910.761429:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135910.761442:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135910.761486:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135910.761582:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135910.761665:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.761828:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753280 00000100:00100000:1.0:1789135910.761836:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753280 00000100:00100000:1.0:1789135910.761918:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789135910.761929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666753280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135910.761942:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135910.761955:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b3c expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.761993:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.762004:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.762014:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879a00, rc 0) 00000100:00100000:1.0:1789135910.762075:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666753280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.762083:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789135910.762166:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135910.762183:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135910.762193:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135910.762262:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.762294:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135910.762330:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135910.762435:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753408 00000100:00100000:0.0:1789135910.762440:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753408 00000100:00100000:0.0:1789135910.762480:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789135910.762488:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666753408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135910.762601:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666753408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.762608:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789135910.762918:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.762950:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.762993:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135910.768550:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135910.770917:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753536 00000100:00100000:3.0:1789135910.770933:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753536 00000100:00100000:3.0:1789135910.771006:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789135910.771017:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666753536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135910.772487:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666753536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1466us (9487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135910.772699:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789135910.778171:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135910.783610:0:13740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13740:1876044666753664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135910.783721:0:13740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135910.783782:0:13740:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.784206:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753664 00000100:00100000:1.0:1789135910.784213:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753664 00000100:00100000:1.0:1789135910.784266:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789135910.784275:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:13740:x1876044666753664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.784415:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:13740:x1876044666753664:12345-0@lo:502:llog_process_th.0 Request processed in 140us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.784424:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789135910.784600:0:13740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13740:1876044666753664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135910.784709:0:13740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135910.784721:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135910.784723:0:13740:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789135910.784732:0:13740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c2291000 00000020:00000080:3.0:1789135910.784735:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135910.784843:0:13740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13740:1876044666753792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135910.784921:0:13740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135910.784948:0:13740:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.785043:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753792 00000100:00100000:1.0:1789135910.785047:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753792 00000100:00100000:1.0:1789135910.785078:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789135910.785084:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:13740:x1876044666753792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.785163:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:13740:x1876044666753792:12345-0@lo:502:llog_process_th.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.785169:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789135910.785899:0:13740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13740:1876044666753792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135910.785927:0:13740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135910.785937:0:13740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135910.785939:0:13740:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789135910.785945:0:13740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789135910.787458:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789135910.787490:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135910.787512:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.787525:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135910.787536:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135910.787538:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7e761a000 from 7 10000000:01000000:1.0:1789135910.787541:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135910.787574:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.787582:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.787592:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135910.787626:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.787689:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.787740:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135910.787887:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666753920 00000100:00100000:0.0:1789135910.787900:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666753920 00000100:00100000:0.0:1789135910.787951:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789135910.787961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666753920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135910.787973:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135910.787983:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b4a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135910.788006:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135910.788015:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135910.788023:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031800, rc 0) 00000100:00100000:0.0:1789135910.788067:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666753920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.788074:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789135910.788206:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666753920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135910.788221:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135910.788231:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135910.788290:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.788319:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135910.788350:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135910.788459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754048 00000100:00100000:0.0:1789135910.788464:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754048 00000100:00100000:0.0:1789135910.788499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789135910.788506:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666754048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135910.788607:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666754048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.788627:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789135910.791023:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.791098:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.791189:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135910.791237:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135910.791297:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754176 00000100:00100000:0.0:1789135910.791304:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754176 00000100:00100000:0.0:1789135910.791366:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789135910.791376:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666754176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135910.791497:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666754176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.791505:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789135910.791717:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.793077:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13741:1876044666754304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.793157:0:13741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.793202:0:13741:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135910.793253:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754304 00000100:00100000:2.0:1789135910.793259:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754304 00000100:00100000:2.0:1789135910.793296:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789135910.793304:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:13741:x1876044666754304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135910.793420:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:13741:x1876044666754304:12345-0@lo:502:llog_process_th.0 Request processed in 115us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135910.793428:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789135910.793991:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13741:1876044666754304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135910.794021:0:13741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135910.794032:0:13741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135910.794033:0:13741:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789135910.794039:0:13741:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7e761a000 00000020:00000080:1.0:1789135910.794046:0:13741:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135910.794125:0:13741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13741:1876044666754432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.794165:0:13741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.794199:0:13741:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135910.794438:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754432 00000100:00100000:0.0:1789135910.794445:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754432 00000100:00100000:0.0:1789135910.794476:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789135910.794484:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:13741:x1876044666754432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135910.794573:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:13741:x1876044666754432:12345-0@lo:502:llog_process_th.0 Request processed in 90us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.794580:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789135910.795768:0:13741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13741:1876044666754432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135910.795808:0:13741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135910.795818:0:13741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135910.795821:0:13741:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789135910.795824:0:13741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789135910.796130:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789135910.796153:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135910.796170:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135910.796183:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135910.796194:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135910.796197:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 7 10000000:01000000:2.0:1789135910.796200:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135910.796234:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135910.796242:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135910.796251:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135910.796270:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.796325:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135910.796377:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135910.796508:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754560 00000100:00100000:0.0:1789135910.796515:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754560 00000100:00100000:0.0:1789135910.796560:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789135910.796568:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666754560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135910.796581:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135910.796593:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b58 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135910.796694:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135910.796708:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135910.796718:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030a00, rc 0) 00000100:00100000:0.0:1789135910.796764:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666754560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135910.796782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789135910.798075:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135910.798110:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135910.798123:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135910.798196:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135910.798257:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135910.798302:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.799878:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754688 00000100:00100000:1.0:1789135910.799891:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754688 00000100:00100000:1.0:1789135910.799950:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789135910.799959:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666754688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.800133:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666754688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.800141:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789135910.800194:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.800240:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.800288:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.800319:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.800332:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754816 00000100:00100000:1.0:1789135910.800346:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754816 00000100:00100000:1.0:1789135910.800368:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789135910.800373:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666754816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.800440:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666754816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.800456:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789135910.800493:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666754816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.806267:0:13743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13743:1876044666754944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.806358:0:13743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.806406:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666754944 00000100:00100000:1.0:1789135910.806412:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666754944 00000100:00100000:1.0:1789135910.806453:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789135910.806460:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:13743:x1876044666754944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.806564:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:13743:x1876044666754944:12345-0@lo:502:llog_process_th.0 Request processed in 104us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.806572:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789135910.806641:0:13743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.806666:0:13743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13743:1876044666754944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135910.806700:0:13743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135910.806712:0:13743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135910.806715:0:13743:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789135910.806721:0:13743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa5f7000 00000020:00000080:1.0:1789135910.806723:0:13743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135910.806803:0:13743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13743:1876044666755072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.806833:0:13743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.806851:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755072 00000100:00100000:1.0:1789135910.806878:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755072 00000100:00100000:1.0:1789135910.806900:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789135910.806906:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:13743:x1876044666755072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.806965:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:13743:x1876044666755072:12345-0@lo:502:llog_process_th.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.806977:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789135910.807003:0:13743:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.807015:0:13743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13743:1876044666755072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135910.807032:0:13743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135910.807037:0:13743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135910.807038:0:13743:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789135910.807042:0:13743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789135910.807116:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789135910.807139:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135910.807150:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807162:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135910.807173:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135910.807175:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 7 10000000:01000000:1.0:1789135910.807178:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135910.807201:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807209:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807219:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135910.807230:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666755200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.807254:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.807273:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.807284:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755200 00000100:00100000:1.0:1789135910.807288:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755200 00000100:00100000:1.0:1789135910.807307:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789135910.807312:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666755200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135910.807321:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135910.807333:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b66 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807357:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807368:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807376:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135910.807401:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666755200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.807406:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789135910.807433:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666755200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135910.807443:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.807452:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135910.807490:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666755328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.807510:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.807528:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.807537:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755328 00000100:00100000:1.0:1789135910.807540:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755328 00000100:00100000:1.0:1789135910.807557:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789135910.807562:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666755328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.807653:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666755328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.807660:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789135910.807689:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666755328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.807713:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666755456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.807746:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.807759:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.807768:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755456 00000100:00100000:1.0:1789135910.807772:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755456 00000100:00100000:1.0:1789135910.807790:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789135910.807795:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666755456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.807886:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666755456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.807893:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789135910.807935:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666755456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135910.808216:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13745:1876044666755584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.808253:0:13745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.808272:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755584 00000100:00100000:1.0:1789135910.808275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755584 00000100:00100000:1.0:1789135910.808296:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789135910.808301:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:13745:x1876044666755584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.808374:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:13745:x1876044666755584:12345-0@lo:502:llog_process_th.0 Request processed in 72us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.808382:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789135910.808412:0:13745:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d23b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.808423:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13745:1876044666755584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135910.808441:0:13745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135910.808448:0:13745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135910.808450:0:13745:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789135910.808455:0:13745:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d26b4800 00000020:00000080:1.0:1789135910.808457:0:13745:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135910.808507:0:13745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13745:1876044666755712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.808534:0:13745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135910.808550:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755712 00000100:00100000:1.0:1789135910.808553:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755712 00000100:00100000:1.0:1789135910.808569:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789135910.808574:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:13745:x1876044666755712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135910.808627:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:13745:x1876044666755712:12345-0@lo:502:llog_process_th.0 Request processed in 52us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135910.808634:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789135910.808661:0:13745:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135910.808671:0:13745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:13745:1876044666755712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135910.808687:0:13745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135910.808691:0:13745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135910.808693:0:13745:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789135910.808696:0:13745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789135910.808748:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789135910.808773:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135910.808781:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135910.808790:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135911.145427:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135912.169884:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135912.296124:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135912.296157:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666755840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135912.296249:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135912.296546:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755840 00000100:00100000:0.0:1789135912.296555:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755840 00000100:00100000:0.0:1789135912.296618:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789135912.296629:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666755840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135912.296666:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135912.296737:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666755840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135912.296745:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789135912.296922:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666755840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135912.808236:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666756096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135912.808331:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135912.808400:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135912.808406:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666755968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135912.808433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135912.808470:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756096 00000100:00100000:3.0:1789135912.808477:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756096 00000100:00100000:3.0:1789135912.808525:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666755968 00000100:00100000:3.0:1789135912.808536:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666755968 00000100:00100000:3.0:1789135912.808557:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789135912.808564:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666756096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135912.808599:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135912.808642:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666756096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135912.808649:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789135912.808667:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789135912.808674:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666755968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135912.808683:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135912.808706:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666755968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135912.808711:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789135912.808726:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789135912.808755:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80b40 x1876044666755968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135912.808791:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666755968:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789135912.808802:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4490b40 x1876044666756096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135912.808812:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666756096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135912.815530:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666756224:0@lo:400:kworker.0 00000100:00100000:1.0:1789135912.815622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135912.822558:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756224 00000100:00100000:0.0:1789135912.822576:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756224 00000100:00100000:0.0:1789135912.822646:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789135912.822657:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666756224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827560:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666756352:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827668:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666756864:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827707:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666757376:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827730:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827756:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789135912.827762:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666756736:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827799:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666757248:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827844:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666756480:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827909:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666756992:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827941:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789135912.827946:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666756608:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.827968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.827986:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666757120:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828009:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135912.828036:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756352 00000100:00100000:2.0:1789135912.828053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756352 00000100:00100000:2.0:1789135912.828104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756864 00000100:00100000:2.0:1789135912.828107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756864 00000100:00100000:2.0:1789135912.828128:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756736 00000100:00100000:2.0:1789135912.828131:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756736 00000100:00100000:2.0:1789135912.828141:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756480 00000100:00100000:2.0:1789135912.828143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756480 00000100:00100000:2.0:1789135912.828152:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756992 00000100:00100000:2.0:1789135912.828154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756992 00000100:00100000:2.0:1789135912.828167:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757120 00000100:00100000:2.0:1789135912.828170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757120 00000100:00100000:2.0:1789135912.828187:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789135912.828194:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666756352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828251:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666756352:12345-0@lo:400:kworker.0 Request processed in 57us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789135912.828280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789135912.828287:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666756864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828330:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666756864:12345-0@lo:400:kworker.0 Request processed in 44us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828336:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789135912.828347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789135912.828353:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666756736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828381:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666756736:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789135912.828398:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789135912.828404:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666756480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828447:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666756480:12345-0@lo:400:kworker.0 Request processed in 43us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828454:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789135912.828466:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789135912.828472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666756992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828498:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666756992:12345-0@lo:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828503:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789135912.828515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789135912.828521:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666757120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666757120:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789135912.828576:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757376 00000100:00100000:2.0:1789135912.828580:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757376 00000100:00100000:2.0:1789135912.828603:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757248 00000100:00100000:2.0:1789135912.828605:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757248 00000100:00100000:2.0:1789135912.828623:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789135912.828629:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666757376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828659:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666757376:12345-0@lo:400:kworker.0 Request processed in 30us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828664:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789135912.828677:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789135912.828682:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666757248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828708:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666757248:12345-0@lo:400:kworker.0 Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828723:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789135912.828755:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666756608 00000100:00100000:2.0:1789135912.828760:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666756608 00000100:00100000:2.0:1789135912.828788:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789135912.828794:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4466580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666756608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828829:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4466580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666756608:12345-0@lo:400:kworker.0 Request processed in 35us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135912.828834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1789135912.828885:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135912.828890:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135912.828892:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135912.828926:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666756736:0@lo:400:kworker.0 00010000:00080000:2.0:1789135912.828940:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe03c0 x1876044666757248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135912.828950:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666757248:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.828959:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666756352:0@lo:400:kworker.0 00010000:00080000:2.0:1789135912.828968:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83480 x1876044666756864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135912.828976:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666756864:0@lo:400:kworker.0 00010000:00080000:2.0:1789135912.828985:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe1e00 x1876044666757376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135912.828993:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666757376:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.829031:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666756608:0@lo:400:kworker.0 00010000:00080000:2.0:1789135912.829050:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe1680 x1876044666757120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135912.829059:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666757120:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.829084:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666756480:0@lo:400:kworker.0 00000100:00100000:2.0:1789135912.829093:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666756992:0@lo:400:kworker.0 00000100:00100000:0.0:1789135912.829983:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666756224:12345-0@lo:400:kworker.0 Request processed in 7323us (14356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135912.829995:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789135912.831106:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666756224:0@lo:400:kworker.0 00010000:00010000:1.0:1789135913.202175:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135913.323363:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135913.323388:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666757504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135913.323461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135913.323544:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757504 00000100:00100000:0.0:1789135913.323553:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757504 00000100:00100000:0.0:1789135913.323604:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789135913.323614:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666757504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135913.323648:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135913.323695:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666757504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135913.323713:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:0.0:1789135913.323761:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4493840 x1876044666757504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135913.323782:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4493840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666757504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135913.326573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666757632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135913.326664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135913.328315:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757632 00000100:00100000:3.0:1789135913.328329:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757632 00000100:00100000:3.0:1789135913.328394:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789135913.328405:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666757632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135913.328433:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135913.328832:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666757632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 428us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135913.328842:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789135913.331596:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f68892c0 x1876044666757632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135913.331629:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666757632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135913.832194:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135913.832225:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666757760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135913.832302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135913.832459:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757760 00000100:00100000:3.0:1789135913.832467:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757760 00000100:00100000:3.0:1789135913.832525:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789135913.832534:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666757760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135913.832570:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135913.832633:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666757760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135913.832640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789135913.832727:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666757760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135914.216229:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135914.494073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135914.494116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135914.494140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135914.494157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135914.494178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135914.494390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639232 00000100:00100000:2.0:1789135914.494400:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639232 00000100:00100000:2.0:1789135914.494463:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 377 00000100:00100000:2.0:1789135914.494475:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644639232:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135914.494563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644639232:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 90us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135914.494571:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 377 00000100:00100000:2.0:1789135914.494610:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639488 00000100:00100000:2.0:1789135914.494613:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639488 00000100:00100000:2.0:1789135914.494644:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639744 00000100:00100000:2.0:1789135914.494647:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639744 00000100:00100000:2.0:1789135914.494661:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639360 00000100:00100000:2.0:1789135914.494663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639360 00000100:00100000:2.0:1789135914.494674:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639616 00000100:00100000:2.0:1789135914.494676:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639616 00000100:00100000:2.0:1789135914.494688:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 261 00000100:00100000:2.0:1789135914.494694:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644639488:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135914.494735:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644639488:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135914.494742:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 261 00000100:00100000:2.0:1789135914.494754:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 262 00000100:00100000:2.0:1789135914.494760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644639744:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135914.494778:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644639744:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 19us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135914.494784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 262 00000100:00100000:2.0:1789135914.494793:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 263 00000100:00100000:2.0:1789135914.494798:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644639360:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135914.494828:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644639360:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135914.494833:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 263 00000100:00100000:2.0:1789135914.494842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 264 00000100:00100000:2.0:1789135914.494847:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644639616:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135914.494895:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644639616:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 47us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135914.494901:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 264 00000100:00080000:2.0:1789135914.494924:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135914.494927:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789135915.257179:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135916.268405:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789135916.540380:0:13978:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd97569570 20000000:00000080:0.0:1789135916.540404:0:13978:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a6c440f000 uarg=0000000000000000 20000000:01000000:0.0:1789135916.540460:0:13978:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789135916.540468:0:13978:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:0.0:1789135916.540475:0:13978:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789135916.541536:0:13979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789135916.541642:0:13978:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789135916.547439:0:13978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:0.0:1789135916.547497:0:13978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 144 off10272 00000040:00080000:0.0:1789135916.547512:0:13978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10496 10000000:01000000:0.0:1789135916.547599:0:13978:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135916.547627:0:13978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547677:0:13978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547686:0:13978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547694:0:13978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547702:0:13978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547709:0:13978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547715:0:13978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.547722:0:13978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.549667:0:13978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.549698:0:13978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 23 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.549719:0:13978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44930c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666757888:0@lo:104: 00000100:00100000:0.0:1789135916.550029:0:13978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135916.550222:0:13978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135916.550372:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666757888 00000100:00100000:1.0:1789135916.550383:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666757888 00000100:00100000:1.0:1789135916.550447:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789135916.550458:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13978:x1876044666757888:12345-0@lo:104: 00010000:00010000:1.0:1789135916.550473:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135916.550545:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135916.550551:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13978:x1876044666757888:12345-0@lo:104: Request processed in 96us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135916.550565:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:0.0:1789135916.550665:0:13978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 23 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.550677:0:13978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758016:0@lo:104: 00000100:00100000:0.0:1789135916.550706:0:13978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135916.550739:0:13978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.550747:0:13978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 23 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.550755:0:13978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758144:0@lo:104: 00000100:00100000:0.0:1789135916.550775:0:13978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135916.550797:0:13978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.550805:0:13978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 23 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.550814:0:13978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758272:0@lo:104: 00010000:00010000:3.0:1789135916.550880:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135916.550890:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135916.550944:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666758016 00000100:00100000:2.0:1789135916.550949:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666758016 00000100:00100000:2.0:1789135916.550972:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666758144 00000100:00100000:2.0:1789135916.550975:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666758144 00000100:00100000:2.0:1789135916.550986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789135916.551016:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13978:x1876044666758016:12345-0@lo:104: 00010000:00010000:2.0:1789135916.551025:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135916.551205:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789135916.551215:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13978:x1876044666758144:12345-0@lo:104: 00010000:00010000:1.0:1789135916.551223:0:10335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.551548:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135916.551554:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13978:x1876044666758016:12345-0@lo:104: Request processed in 541us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135916.551561:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1789135916.551586:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135916.551771:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.551778:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.551785:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135916.551790:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.551800:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135916.551807:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135916.551813:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135916.551889:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.551896:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135916.551920:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.551940:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d600/0x559c8745c6de2b58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b5f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.551954:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.551956:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.551957:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.551973:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.551975:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135916.552328:0:13978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135916.552409:0:13978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.552425:0:13978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 12 pid: 6508 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.552439:0:13978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758528:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135916.552545:0:13978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.552554:0:13978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.552563:0:13978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758656:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135916.552591:0:13978:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c10f8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135916.552622:0:13978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44930c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666757888:0@lo:104: 00000100:00100000:0.0:1789135916.552633:0:13978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758016:0@lo:104: 00000100:00100000:0.0:1789135916.553148:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666758400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135916.553207:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135916.553354:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789135916.553370:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666758272 00000100:00100000:0.0:1789135916.553377:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666758272 00000100:00100000:0.0:1789135916.553420:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789135916.553430:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13978:x1876044666758272:12345-0@lo:104: 00010000:00010000:0.0:1789135916.553445:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.553500:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789135916.553506:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f59450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:44af6ea5-156e-4935-ba38-1972bb1ada25+4:13978:x1876044666758272:12345-0@lo:104: Request processed in 78us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135916.553513:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789135916.553666:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789135916.553675:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553685:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135916.553691:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135916.553697:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135916.553749:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553755:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135916.553788:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553797:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de2b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553814:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135916.553818:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553824:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ee00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789135916.553827:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553867:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789135916.553874:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135916.553879:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789135916.553895:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553901:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789135916.553907:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553914:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2b3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.553924:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135916.553926:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135916.553928:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135916.553943:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666758784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135916.553982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135916.554024:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135916.554031:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666758912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135916.554056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135916.554106:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666758400 00000100:00100000:3.0:1789135916.554110:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666758400 00010000:00010000:3.0:1789135916.554139:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 24 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135916.554179:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666758784 00000100:00100000:3.0:1789135916.554182:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666758784 00010000:00010000:3.0:1789135916.554196:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 25 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135916.554212:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666758912 00000100:00100000:3.0:1789135916.554215:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666758912 00010000:00010000:3.0:1789135916.554224:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 26 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135916.554237:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789135916.554243:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3639:x1876044666758400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135916.554256:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135916.554261:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 26 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554272:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 26 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554289:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de2b5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b58 expref: 26 pid: 6510 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554305:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135916.554341:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3639:x1876044666758400:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135916.554348:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789135916.554404:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789135916.554411:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666758784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135916.554427:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135916.554432:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 24 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554442:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 24 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554453:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de2b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b66 expref: 24 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554462:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135916.554491:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3640:x1876044666758784:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135916.554498:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789135916.554510:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789135916.554516:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3640:x1876044666758912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789135916.554524:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135916.554528:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 22 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554537:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 22 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.554546:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135916.554569:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3640:x1876044666758912:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135916.554575:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789135916.554626:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666758400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135916.554684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666758912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135916.554687:0:13978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879a00/0x559c8745c6de2b43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b3c expref: 21 pid: 6508 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135916.554692:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666758784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135916.554699:0:13978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758272:0@lo:104: 00010000:00010000:2.0:1789135916.554789:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135916.555939:0:10335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135916.555957:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+3:13978:x1876044666758144:12345-0@lo:104: Request processed in 4739us (5176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135916.555968:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789135916.556404:0:13978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758144:0@lo:104: 00010000:00010000:2.0:1789135916.556509:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789135916.556530:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.556541:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789135916.556546:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.556559:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789135916.556567:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135916.556573:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789135916.556638:0:13980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.556645:0:13980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789135916.556677:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.556697:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2b4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b51 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.556716:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.556718:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135916.556719:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135916.557470:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666759040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789135916.557562:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135916.557836:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759040 00000100:00100000:2.0:1789135916.557845:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759040 00010000:00010000:2.0:1789135916.557903:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 21 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135916.557939:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789135916.557949:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666759040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789135916.557965:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135916.557970:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 21 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.557983:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 21 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.558014:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031800/0x559c8745c6de2b51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b4a expref: 21 pid: 6509 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135916.558038:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135916.558078:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3638:x1876044666759040:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135916.558085:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789135916.558444:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666759040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135916.562393:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135916.562524:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644639872 00000100:00100000:1.0:1789135916.562536:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644639872 00010000:00010000:1.0:1789135916.562589:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 13 pid: 6508 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135916.562633:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1789135916.562643:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644639872:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135916.562660:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135916.562665:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 13 pid: 6508 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135916.562680:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 13 pid: 6508 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135916.562725:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135916.562913:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644639872:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 270us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135916.562922:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:3.0:1789135916.565500:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:2.0:1789135916.565975:0:13978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c7 expref: 12 pid: 6508 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135916.566031:0:13978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758528:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135916.566051:0:13978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13978:1876044666758656:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135916.566098:0:13978:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.566272:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640000 00000100:00100000:0.0:1789135916.566285:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640000 00010000:00010000:0.0:1789135916.566337:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.566392:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:0.0:1789135916.566404:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+12:2390:x1876044644640000:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135916.566422:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135916.566428:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566442:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566460:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e000/0x559c8745c6de2b2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088c0 expref: 12 pid: 6509 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566477:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566486:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566514:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566520:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566546:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566553:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566559:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135916.566563:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566573:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566598:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135916.566609:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135916.566633:0:13978:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.566645:0:13978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135916.566652:0:13978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031200/0x559c8745c6de2b74 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135916.566683:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+11:2390:x1876044644640000:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 279us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135916.566693:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00010000:00010000:3.0:1789135917.291911:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135917.416485:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666759168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135917.416564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135917.416807:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759168 00000100:00100000:0.0:1789135917.416815:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759168 00000100:00100000:0.0:1789135917.418541:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789135917.418561:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666759168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135917.418601:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135917.418701:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666759168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135917.418710:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789135917.423103:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666759168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135917.928253:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135917.928280:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666759296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135917.928368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.928457:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759296 00000100:00100000:2.0:1789135917.928465:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759296 00000100:00100000:2.0:1789135917.928520:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789135917.928531:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666759296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135917.928560:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135917.928620:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666759296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.928627:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1789135917.928648:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135917.928682:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f68892c0 x1876044666759296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135917.928701:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f68892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666759296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135917.928901:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666759552:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.928933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135917.928953:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666760064:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.928984:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135917.928998:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666760576:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135917.929041:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789135917.929047:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666759680:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929070:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135917.929106:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666760192:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929126:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135917.929145:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666760704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929167:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135917.929198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759552 00000100:00100000:3.0:1789135917.929202:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759552 00000100:00100000:3.0:1789135917.929235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760064 00000100:00100000:3.0:1789135917.929238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760064 00000100:00100000:3.0:1789135917.929260:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760576 00000100:00100000:3.0:1789135917.929263:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760576 00000100:00100000:3.0:1789135917.929273:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760192 00000100:00100000:3.0:1789135917.929275:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760192 00000100:00100000:3.0:1789135917.929289:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789135917.929295:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666759552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929330:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666759552:12345-0@lo:400:kworker.0 Request processed in 36us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.929337:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789135917.929347:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789135917.929352:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666760064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929374:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666760064:12345-0@lo:400:kworker.0 Request processed in 22us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.929379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789135917.929389:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789135917.929394:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666760576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666760576:12345-0@lo:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.929422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789135917.929438:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789135917.929444:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666760192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666760192:12345-0@lo:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.929477:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789135917.929497:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759680 00000100:00100000:3.0:1789135917.929500:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759680 00000100:00100000:3.0:1789135917.929526:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789135917.929532:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666759680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929561:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666759680:12345-0@lo:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.929567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789135917.929584:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760704 00000100:00100000:3.0:1789135917.929587:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760704 00000100:00100000:3.0:1789135917.929612:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789135917.929618:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666760704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929639:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666760704:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.929643:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1789135917.929656:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135917.929659:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135917.929661:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135917.929680:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666759680:0@lo:400:kworker.0 00010000:00080000:3.0:1789135917.929690:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5a52c0 x1876044666760192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135917.929699:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666760192:0@lo:400:kworker.0 00010000:00080000:3.0:1789135917.929719:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671ed00 x1876044666760704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135917.929726:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666760704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929734:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666759552:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.929739:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666760064:0@lo:400:kworker.0 00010000:00080000:3.0:1789135917.929744:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662b840 x1876044666760576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135917.929748:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666760576:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.929836:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666759424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.929877:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.929902:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666759936:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.929917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.929935:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666760448:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.929948:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.929958:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789135917.929962:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666759808:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.929989:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.930005:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666760320:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.930031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.930047:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666760832:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.930067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135917.930088:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760320 00000100:00100000:1.0:1789135917.930089:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759936 00000100:00100000:2.0:1789135917.930092:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760320 00000100:00100000:1.0:1789135917.930092:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759936 00000100:00100000:2.0:1789135917.930116:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760832 00000100:00100000:1.0:1789135917.930117:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789135917.930119:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760832 00000100:00100000:1.0:1789135917.930122:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666759936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.930134:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135917.930139:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666760320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135917.930173:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666759936:12345-0@lo:400:kworker.0 Request processed in 50us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.930179:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135917.930202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760448 00000100:00100000:1.0:1789135917.930206:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760448 00000100:00100000:1.0:1789135917.930358:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759808 00000100:00100000:1.0:1789135917.930362:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759808 00000100:00100000:1.0:1789135917.930385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789135917.930391:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666760448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.930464:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666759424 00000100:00100000:3.0:1789135917.930468:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666759424 00000100:00100000:3.0:1789135917.930498:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789135917.930506:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666759424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.930922:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666760320:12345-0@lo:400:kworker.0 Request processed in 781us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.930929:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789135917.930946:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789135917.930954:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666760832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.930999:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666760832:12345-0@lo:400:kworker.0 Request processed in 46us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.931004:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789135917.931032:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789135917.931040:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666759808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.931070:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666759808:12345-0@lo:400:kworker.0 Request processed in 31us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135917.931086:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1789135917.931105:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135917.931109:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135917.931111:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135917.931155:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666759808:0@lo:400:kworker.0 00010000:00080000:2.0:1789135917.931169:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6628b40 x1876044666760320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135917.931179:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6628b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666760320:0@lo:400:kworker.0 00010000:00080000:2.0:1789135917.931190:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f671e1c0 x1876044666760832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135917.931198:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666760832:0@lo:400:kworker.0 00000100:00100000:0.0:1789135917.933493:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135917.933523:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135917.933606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135917.933659:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666760960 00000100:00100000:0.0:1789135917.933666:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666760960 00000100:00100000:0.0:1789135917.933712:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789135917.933720:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666760960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135917.933741:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135917.933949:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666760960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135917.933960:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:0.0:1789135917.934016:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fbc000 x1876044666760960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135917.934468:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135917.937242:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666759424:0@lo:400:kworker.0 00000100:00100000:2.0:1789135917.937266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666759936:0@lo:400:kworker.0 00000100:00100000:3.0:1789135917.937303:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3641:x1876044666759424:12345-0@lo:400:kworker.0 Request processed in 6796us (7422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135917.937314:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789135917.937880:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666760448:12345-0@lo:400:kworker.0 Request processed in 7486us (7927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135917.937890:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789135917.950437:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666760448:0@lo:400:kworker.0 10000000:01000000:0.0:1789135918.248017:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135918.248034:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c2291000 from 10 10000000:01000000:0.0:1789135918.248041:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135918.248094:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.248106:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.248117:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135918.248143:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.248228:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.248382:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135918.253195:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761088 00000100:00100000:1.0:1789135918.253225:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761088 00000100:00100000:1.0:1789135918.253302:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789135918.253313:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666761088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135918.253332:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135918.253356:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b7b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.253399:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.253410:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.253419:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878800, rc 0) 00000100:00100000:1.0:1789135918.253514:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666761088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (5286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.253530:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789135918.255479:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135918.255512:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.255525:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135918.255621:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.255680:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.255753:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.258350:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761216 00000100:00100000:0.0:1789135918.258365:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761216 00000100:00100000:0.0:1789135918.258444:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789135918.258457:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666761216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.258653:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666761216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (2972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.258662:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789135918.258786:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.258840:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.258931:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.258984:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135918.259887:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761344 00000100:00100000:1.0:1789135918.259895:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761344 00000100:00100000:1.0:1789135918.259936:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789135918.259945:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666761344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135918.260093:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666761344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.260101:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789135918.260290:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.265000:0:14040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14040:1876044666761472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.265108:0:14040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.265167:0:14040:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135918.265301:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761472 00000100:00100000:1.0:1789135918.265309:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761472 00000100:00100000:1.0:1789135918.265370:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789135918.265379:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14040:x1876044666761472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135918.265512:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14040:x1876044666761472:12345-0@lo:502:llog_process_th.0 Request processed in 133us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.265519:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789135918.266368:0:14040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14040:1876044666761472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135918.266408:0:14040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135918.266418:0:14040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135918.266421:0:14040:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789135918.266428:0:14040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c2291000 00000020:00000080:0.0:1789135918.266430:0:14040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789135918.266666:0:14040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14040:1876044666761600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.266724:0:14040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.266766:0:14040:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135918.266827:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761600 00000100:00100000:2.0:1789135918.266833:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761600 00000100:00100000:2.0:1789135918.266902:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789135918.266911:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14040:x1876044666761600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135918.267014:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14040:x1876044666761600:12345-0@lo:502:llog_process_th.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.267033:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789135918.267186:0:14040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14040:1876044666761600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135918.267208:0:14040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135918.267213:0:14040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135918.267215:0:14040:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789135918.267218:0:14040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:1.0:1789135918.267445:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135918.268376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640128 00000100:00100000:0.0:1789135918.268384:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640128 00000100:00100000:0.0:1789135918.268436:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 384 00000100:00100000:0.0:1789135918.268444:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:6167:x1876044644640128:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135918.268457:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135918.268474:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.268502:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.268514:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.268540:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:0.0:1789135918.268601:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644640128:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 157us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.268608:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 384 00000020:01000000:2.0:1789135918.268694:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789135918.268721:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789135918.268731:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.268740:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789135918.268751:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789135918.268754:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7e761a000 from 10 10000000:01000000:2.0:1789135918.268757:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789135918.268783:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.268791:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.268807:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135918.268828:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.268897:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.268933:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.269191:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761728 00000100:00100000:0.0:1789135918.269196:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761728 00000100:00100000:0.0:1789135918.269219:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1789135918.269235:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666761728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135918.269243:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135918.269252:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b90 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.269268:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.269277:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.269291:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031400, rc 0) 00000100:00100000:0.0:1789135918.269322:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666761728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.269327:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789135918.274507:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135918.274557:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.274571:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135918.274663:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.274722:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.274774:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135918.275511:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761856 00000100:00100000:3.0:1789135918.275520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761856 00000100:00100000:3.0:1789135918.275770:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789135918.275791:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666761856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135918.275954:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666761856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135918.275963:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789135918.276268:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.276316:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.276371:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.276412:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135918.278198:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666761984 00000100:00100000:3.0:1789135918.278213:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666761984 00000100:00100000:3.0:1789135918.278308:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789135918.278317:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666761984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135918.278809:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666761984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 491us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135918.278817:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789135918.279001:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666761984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.285098:0:14042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14042:1876044666762112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135918.285184:0:14042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.285240:0:14042:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.285312:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762112 00000100:00100000:0.0:1789135918.285319:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762112 00000100:00100000:0.0:1789135918.285372:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789135918.285382:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14042:x1876044666762112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.285504:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14042:x1876044666762112:12345-0@lo:502:llog_process_th.0 Request processed in 122us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.285512:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789135918.285713:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135918.285745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640256 00000100:00100000:1.0:1789135918.285749:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640256 00000100:00100000:1.0:1789135918.285778:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 389 00000100:00100000:1.0:1789135918.285785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644640256:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135918.285903:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644640256:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 118us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.285911:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 389 00000100:00100000:2.0:1789135918.286572:0:14042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14042:1876044666762112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135918.286607:0:14042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135918.286619:0:14042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135918.286621:0:14042:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789135918.286629:0:14042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7e761a000 00000020:00000080:2.0:1789135918.286632:0:14042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789135918.286717:0:14042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14042:1876044666762240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135918.286759:0:14042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.286785:0:14042:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789135918.287596:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762240 00000100:00100000:1.0:1789135918.287603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762240 00000100:00100000:1.0:1789135918.287652:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789135918.287661:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14042:x1876044666762240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135918.287781:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14042:x1876044666762240:12345-0@lo:502:llog_process_th.0 Request processed in 120us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.287789:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789135918.287899:0:14042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14042:1876044666762240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135918.287926:0:14042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789135918.287933:0:14042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135918.287935:0:14042:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789135918.287939:0:14042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789135918.288341:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789135918.288455:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135918.288466:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.288477:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789135918.288488:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135918.288491:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 10 10000000:01000000:1.0:1789135918.288494:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135918.288835:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.288845:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.289482:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135918.289611:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666762368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.289671:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.289716:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135918.289765:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762368 00000100:00100000:2.0:1789135918.289772:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762368 00000100:00100000:2.0:1789135918.289825:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789135918.289834:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666762368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135918.289847:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135918.289887:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2b9e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.289912:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.289923:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.289944:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94de00, rc 0) 00000100:00100000:2.0:1789135918.289992:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666762368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.289998:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789135918.290385:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666762368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135918.290403:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.290413:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135918.290482:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666762496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.290511:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135918.290942:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762496 00000100:00100000:1.0:1789135918.290947:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762496 00000100:00100000:1.0:1789135918.290988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789135918.290997:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666762496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789135918.291124:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666762496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.291131:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789135918.299980:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135918.300025:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640384 00000100:00100000:1.0:1789135918.300035:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640384 00000100:00100000:1.0:1789135918.300083:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 393 00000100:00100000:1.0:1789135918.300093:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644640384:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135918.300257:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644640384:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 164us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.300266:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 393 00000100:00100000:1.0:1789135918.308110:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135918.308157:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640512 00000100:00100000:1.0:1789135918.308169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640512 00000100:00100000:1.0:1789135918.308218:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 394 00000100:00100000:1.0:1789135918.308361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:10392:x1876044644640512:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135918.308504:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:10392:x1876044644640512:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 277us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.308523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 394 00000100:00100000:0.0:1789135918.308759:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.308792:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666762496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.308875:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666762624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.308919:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.308942:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.308959:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762624 00000100:00100000:0.0:1789135918.308962:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762624 00000100:00100000:0.0:1789135918.308996:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789135918.309003:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666762624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.309098:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666762624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.309106:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789135918.309147:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666762624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.309455:0:14044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14044:1876044666762752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.309490:0:14044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.309509:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762752 00000100:00100000:0.0:1789135918.309512:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762752 00000100:00100000:0.0:1789135918.309530:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789135918.309536:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14044:x1876044666762752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.309603:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14044:x1876044666762752:12345-0@lo:502:llog_process_th.0 Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.309610:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789135918.309639:0:14044:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.309650:0:14044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14044:1876044666762752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135918.309672:0:14044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135918.309681:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135918.309689:0:14044:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789135918.309697:0:14044:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa5f7000 00000020:00000080:0.0:1789135918.309700:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135918.311200:0:14044:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14044:1876044666762880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135918.311509:0:14044:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135918.311563:0:14044:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135918.311625:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666762880 00000100:00100000:2.0:1789135918.311632:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666762880 00000100:00100000:2.0:1789135918.311684:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789135918.311694:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14044:x1876044666762880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135918.311807:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14044:x1876044666762880:12345-0@lo:502:llog_process_th.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.311815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789135918.312327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135918.313361:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640640 00000100:00100000:1.0:1789135918.313369:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640640 00000100:00100000:1.0:1789135918.313415:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 398 00000100:00100000:1.0:1789135918.313423:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:10392:x1876044644640640:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789135918.313543:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:10392:x1876044644640640:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 119us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135918.313551:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 398 00000100:00100000:1.0:1789135918.313925:0:14044:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14044:1876044666762880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135918.313959:0:14044:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135918.313980:0:14044:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135918.313982:0:14044:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789135918.313988:0:14044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789135918.315735:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789135918.315772:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135918.315781:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.315794:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135918.315805:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135918.315808:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 10 10000000:01000000:0.0:1789135918.315810:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135918.315844:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.315874:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.315886:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135918.315910:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666763008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.315984:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.316221:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763008 00000100:00100000:2.0:1789135918.316653:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763008 00000100:00100000:2.0:1789135918.316712:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789135918.316723:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666763008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135918.316737:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135918.316751:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2bac expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.316778:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2bac expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.316789:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2bac expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135918.316798:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94c000, rc 0) 00000100:00100000:2.0:1789135918.316851:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666763008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.316879:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00010000:3.0:1789135918.319721:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135918.320091:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.320941:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666763008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789135918.321011:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135918.321036:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135918.321768:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666763136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.321887:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.321938:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135918.324055:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763136 00000100:00100000:2.0:1789135918.324070:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763136 00000100:00100000:2.0:1789135918.324142:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789135918.324152:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666763136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.324582:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666763136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.324590:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1789135918.324770:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666763136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.324829:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666763264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.324919:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.324953:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.324982:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763264 00000100:00100000:0.0:1789135918.324986:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763264 00000100:00100000:0.0:1789135918.325016:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789135918.325034:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666763264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.325114:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666763264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.325119:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789135918.325160:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666763264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.326189:0:14046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14046:1876044666763392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.326242:0:14046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.326275:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763392 00000100:00100000:0.0:1789135918.326281:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763392 00000100:00100000:0.0:1789135918.326314:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789135918.326322:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14046:x1876044666763392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.326424:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14046:x1876044666763392:12345-0@lo:502:llog_process_th.0 Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.326431:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789135918.326481:0:14046:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135918.326518:0:14046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14046:1876044666763392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135918.326553:0:14046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789135918.326562:0:14046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135918.326565:0:14046:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789135918.326572:0:14046:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d26b4800 00000020:00000080:0.0:1789135918.326574:0:14046:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789135918.327177:0:14046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14046:1876044666763520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135918.327223:0:14046:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135918.327250:0:14046:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135918.327354:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763520 00000100:00100000:2.0:1789135918.327359:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763520 00000100:00100000:2.0:1789135918.327399:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789135918.327407:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14046:x1876044666763520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135918.327491:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14046:x1876044666763520:12345-0@lo:502:llog_process_th.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.327499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1789135918.328816:0:14046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14046:1876044666763520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789135918.328871:0:14046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789135918.328880:0:14046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789135918.328883:0:14046:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789135918.328888:0:14046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789135918.332328:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789135918.332373:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789135918.332387:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135918.332399:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135918.342807:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135918.342903:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640768 00000100:00100000:3.0:1789135918.342913:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640768 00000100:00100000:3.0:1789135918.342980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 404 00000100:00100000:3.0:1789135918.342991:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644640768:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135918.343011:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135918.343041:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135918.343073:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135918.343085:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135918.343095:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ee00, rc 0) 00000100:00100000:3.0:1789135918.343154:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644640768:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 165us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135918.343162:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 404 00000100:00100000:3.0:1789135918.345387:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135918.345466:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644640896 00000100:00100000:0.0:1789135918.345476:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644640896 00000100:00100000:0.0:1789135918.345533:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 405 00000100:00100000:0.0:1789135918.345544:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644640896:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135918.345697:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644640896:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 154us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.345705:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 405 00000100:00100000:3.0:1789135918.366151:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135918.366380:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641024 00000100:00100000:2.0:1789135918.366389:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641024 00000100:00100000:2.0:1789135918.366440:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 406 00000100:00100000:2.0:1789135918.366450:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644641024:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135918.366587:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644641024:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 137us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.366595:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 406 00000100:00100000:2.0:1789135918.369739:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135918.370249:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641152 00000100:00100000:3.0:1789135918.370263:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641152 00000100:00100000:3.0:1789135918.370324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 407 00000100:00100000:3.0:1789135918.370335:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:10395:x1876044644641152:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135918.370491:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:10395:x1876044644641152:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 157us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135918.370499:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 407 00000100:00100000:2.0:1789135918.380657:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135918.381099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641280 00000100:00100000:0.0:1789135918.381121:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641280 00000100:00100000:0.0:1789135918.381179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 408 00000100:00100000:0.0:1789135918.381191:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:10395:x1876044644641280:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789135918.381560:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:10395:x1876044644641280:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 370us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135918.381569:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 408 00000100:00100000:1.0:1789135918.440309:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135918.440336:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666763776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135918.440430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135918.440803:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763776 00000100:00100000:2.0:1789135918.440814:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763776 00000100:00100000:2.0:1789135918.440896:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789135918.440907:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666763776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135918.440938:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135918.440999:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666763776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135918.441006:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:1.0:1789135918.441726:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80f00 x1876044666763776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135918.441748:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666763776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135918.441914:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666763648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135918.441954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135918.442335:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763648 00000100:00100000:3.0:1789135918.442341:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763648 00000100:00100000:3.0:1789135918.442381:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789135918.442389:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666763648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135918.442405:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135918.442445:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666763648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135918.442452:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1789135918.442639:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fbe940 x1876044666763648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135918.442654:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666763648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135918.955241:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666763904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135918.955361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135918.955514:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666763904 00000100:00100000:3.0:1789135918.955524:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666763904 00000100:00100000:3.0:1789135918.955601:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789135918.955613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666763904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135918.955661:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135918.955723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666763904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135918.955741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789135918.956172:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666763904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135919.338524:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135919.602490:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135919.602544:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135919.602585:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135919.602593:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641536 00000100:00100000:0.0:1789135919.602608:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641536 00000100:00100000:3.0:1789135919.602615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135919.602655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135919.602716:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641664 00000100:00100000:3.0:1789135919.602729:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641792 00000100:00100000:3.0:1789135919.602739:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641792 00000100:00100000:3.0:1789135919.602784:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641920 00000100:00100000:3.0:1789135919.602788:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641920 00000100:00100000:3.0:1789135919.602809:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 271 00000100:00100000:3.0:1789135919.602821:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644641536:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135919.602966:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6628b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644641536:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 146us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.602976:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 271 00000100:00100000:3.0:1789135919.603001:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 272 00000100:00100000:3.0:1789135919.603008:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644641792:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135919.603036:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644641792:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.603045:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 272 00000100:00100000:3.0:1789135919.603062:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 273 00000100:00100000:0.0:1789135919.603075:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641664 00000100:00100000:3.0:1789135919.603076:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644641920:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135919.603141:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 274 00000100:00100000:0.0:1789135919.603153:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644641664:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135919.603166:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644641920:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 92us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135919.603176:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 273 00000100:00100000:0.0:1789135919.603236:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644641664:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 83us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135919.603247:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 274 00000100:00080000:0.0:1789135919.603307:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135919.603313:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135919.604587:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644641408 00000100:00100000:2.0:1789135919.604599:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644641408 00000100:00100000:2.0:1789135919.604654:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 409 00000100:00100000:2.0:1789135919.604662:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644641408:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135919.605119:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644641408:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 455us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135919.605128:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 409 00010000:00010000:3.0:1789135920.362356:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135921.394652:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135922.415696:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135922.542077:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135922.542101:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666764032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135922.542206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135922.542288:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764032 00000100:00100000:1.0:1789135922.542296:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764032 00000100:00100000:1.0:1789135922.542355:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135922.542365:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666764032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135922.542410:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135922.542477:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666764032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135922.542486:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789135922.542546:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666764032:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789135922.816843:0:14181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:12:01 (1789135921) === 00000100:00100000:1.0:1789135923.048392:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135923.048441:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666764160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135923.048537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.048665:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764160 00000100:00100000:1.0:1789135923.048674:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764160 00000100:00100000:1.0:1789135923.048757:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789135923.048770:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666764160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135923.048806:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135923.048887:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666764160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.048895:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1789135923.048919:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789135923.048955:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83480 x1876044666764160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.048978:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666764160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135923.049900:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789135923.049940:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666764288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135923.049988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.051109:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764288 00000100:00100000:1.0:1789135923.051122:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764288 00000100:00100000:1.0:1789135923.051177:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789135923.051186:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666764288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135923.051210:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135923.051269:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666764288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.051277:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789135923.051304:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666764416:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.051363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.051399:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666764928:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.051456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.051475:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666765440:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.051502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.051558:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135923.051846:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666764544:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.051911:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.051932:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666765056:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.051955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.051974:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666765568:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.051997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.052035:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666764672:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052060:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.052079:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666765184:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.052122:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666765696:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052143:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789135923.052172:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fbcf00 x1876044666764288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.052194:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666764288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135923.052213:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789135923.052219:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666764800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.052254:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666765312:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052272:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.052295:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764416 00000100:00100000:1.0:1789135923.052300:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764416 00000100:00100000:1.0:1789135923.052341:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789135923.052348:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666764416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052399:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666764416:12345-0@lo:400:kworker.0 Request processed in 51us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.052407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789135923.052439:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764928 00000100:00100000:1.0:1789135923.052444:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764928 00000100:00100000:1.0:1789135923.052468:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764672 00000100:00100000:1.0:1789135923.052471:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764672 00000100:00100000:1.0:1789135923.052486:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135923.052491:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666764928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052525:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666764928:12345-0@lo:400:kworker.0 Request processed in 34us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.052532:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135923.052542:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135923.052548:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666764672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.052896:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666764672:12345-0@lo:400:kworker.0 Request processed in 346us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.052903:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135923.052926:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765440 00000100:00100000:1.0:1789135923.052929:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765440 00000100:00100000:1.0:1789135923.052953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764544 00000100:00100000:1.0:1789135923.052956:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764544 00000100:00100000:1.0:1789135923.052967:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765056 00000100:00100000:1.0:1789135923.052969:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765056 00000100:00100000:1.0:1789135923.052980:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765184 00000100:00100000:1.0:1789135923.052983:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765184 00000100:00100000:1.0:1789135923.052995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666764800 00000100:00100000:1.0:1789135923.052997:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666764800 00000100:00100000:1.0:1789135923.053007:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765312 00000100:00100000:1.0:1789135923.053009:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765312 00000100:00100000:1.0:1789135923.053035:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789135923.053041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666765440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.053073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666765440:12345-0@lo:400:kworker.0 Request processed in 33us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.053079:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789135923.053096:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789135923.053101:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666764544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.053129:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666764544:12345-0@lo:400:kworker.0 Request processed in 28us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.053134:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789135923.053146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789135923.053153:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666765056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.053178:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666765056:12345-0@lo:400:kworker.0 Request processed in 27us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.053183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789135923.053195:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789135923.053201:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666765184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.053226:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666765184:12345-0@lo:400:kworker.0 Request processed in 25us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.053231:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789135923.053244:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789135923.053249:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666764800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.053276:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666764800:12345-0@lo:400:kworker.0 Request processed in 27us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.053281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789135923.053302:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789135923.053308:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666765312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135923.053589:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765568 00000100:00100000:2.0:1789135923.053595:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765568 00000100:00100000:2.0:1789135923.053625:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765696 00000100:00100000:2.0:1789135923.053629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765696 00000100:00100000:2.0:1789135923.053651:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789135923.053658:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666765568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135923.053690:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666765568:12345-0@lo:400:kworker.0 Request processed in 33us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135923.053705:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789135923.053718:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789135923.053724:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666765696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135923.053755:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666765696:12345-0@lo:400:kworker.0 Request processed in 31us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135923.053761:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789135923.054948:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666765312:12345-0@lo:400:kworker.0 Request processed in 1635us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135923.054959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:1.0:1789135923.055011:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135923.055017:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135923.055020:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135923.055022:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135923.055063:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666764800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.055075:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666765312:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.055086:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666764672:0@lo:400:kworker.0 00010000:00080000:1.0:1789135923.055099:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b43c0 x1876044666765184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.055110:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666765184:0@lo:400:kworker.0 00010000:00080000:1.0:1789135923.055295:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b1a40 x1876044666765696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.055305:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666765696:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.055421:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666764544:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.055432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666765056:0@lo:400:kworker.0 00010000:00080000:1.0:1789135923.055443:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44912c0 x1876044666765568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.055451:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666765568:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.055476:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666764416:0@lo:400:kworker.0 00000100:00100000:1.0:1789135923.055487:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666764928:0@lo:400:kworker.0 00010000:00080000:1.0:1789135923.055497:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44930c0 x1876044666765440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.055504:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666765440:0@lo:400:kworker.0 00010000:00010000:3.0:1789135923.435700:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135923.560663:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135923.560689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666765952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135923.560767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135923.560936:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666765824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135923.560967:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135923.561066:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765952 00000100:00100000:0.0:1789135923.561074:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765952 00000100:00100000:0.0:1789135923.562289:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666765824 00000100:00100000:0.0:1789135923.562298:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666765824 00000100:00100000:0.0:1789135923.562343:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789135923.562352:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666765952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135923.562382:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135923.562446:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666765952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135923.562453:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789135923.562483:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789135923.562490:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666765824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135923.562499:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135923.562519:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666765824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135923.562523:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:1.0:1789135923.564660:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fbc000 x1876044666765824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135923.564689:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666765824:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789135923.565839:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e80000 x1876044666765952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135923.565894:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666765952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135924.073543:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135924.073569:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666766080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135924.074756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135924.074891:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766080 00000100:00100000:0.0:1789135924.074900:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766080 00000100:00100000:0.0:1789135924.074951:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789135924.074961:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666766080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789135924.075000:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789135924.077396:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666766080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2427us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135924.077411:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789135924.080509:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666766080:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135924.456096:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135924.726723:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135924.726784:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.726798:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642048 00000100:00100000:2.0:1789135924.726810:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642048 00000100:00100000:3.0:1789135924.726820:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.726914:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 411 00000100:00100000:2.0:1789135924.726925:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644642048:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135924.727007:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644642048:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135924.727014:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 411 00000100:00100000:3.0:1789135924.727066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.727143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642176 00000100:00100000:1.0:1789135924.727148:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642176 00000100:00100000:1.0:1789135924.727208:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642304 00000100:00100000:1.0:1789135924.727212:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642304 00000100:00100000:3.0:1789135924.727217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.727231:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642432 00000100:00100000:1.0:1789135924.727235:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642432 00000100:00100000:1.0:1789135924.727252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 281 00000100:00100000:1.0:1789135924.727260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644642176:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135924.727314:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644642176:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 54us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.727322:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 281 00000100:00100000:1.0:1789135924.727336:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642560 00000100:00100000:1.0:1789135924.727339:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642560 00000100:00100000:1.0:1789135924.727357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 282 00000100:00100000:1.0:1789135924.727364:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644642304:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135924.727403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644642304:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 39us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.727410:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 282 00000100:00100000:1.0:1789135924.727423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 283 00000100:00100000:1.0:1789135924.727430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644642432:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135924.727455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644642432:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.727462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 283 00000100:00100000:1.0:1789135924.727475:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 284 00000100:00100000:1.0:1789135924.727482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644642560:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135924.727523:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644642560:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.727529:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 284 00000100:00080000:1.0:1789135924.727557:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135924.727563:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789135924.775081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135924.776217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642816 00000100:00100000:3.0:1789135924.776230:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642816 00000100:00100000:3.0:1789135924.776292:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:3.0:1789135924.776302:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:10766:x1876044644642816:12345-192.168.201.31@tcp:700:mkdir.0 00000100:00100000:3.0:1789135924.776389:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:10766:x1876044644642816:12345-192.168.201.31@tcp:700:mkdir.0 Request processed in 88us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135924.776397:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:3.0:1789135924.778599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.779375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644642688 00000100:00100000:1.0:1789135924.779385:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644642688 00000100:00100000:1.0:1789135924.779476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:1.0:1789135924.779488:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644642688:12345-192.168.201.31@tcp:41:mkdir.0 00000004:00000024:1.0:1789135924.779530:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135924.779628:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644642688:12345-192.168.201.31@tcp:41:mkdir.0 Request processed in 141us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.779636:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:0.0:1789135924.780176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.780286:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644643072 00000100:00100000:1.0:1789135924.780302:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644643072 00000100:00100000:1.0:1789135924.780339:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:1.0:1789135924.780346:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:10766:x1876044644643072:12345-192.168.201.31@tcp:36:mkdir.0 00010000:00010000:1.0:1789135924.780387:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135924.780416:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de29c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0882d expref: 6 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.780447:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3b00) 00010000:00010000:1.0:1789135924.780458:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135924.780537:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.780550:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.780559:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.780621:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.780629:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.780636:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781426:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781445:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781455:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135924.781472:0:6515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000009bdef6 reply state 0000000050802d0d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781482:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781489:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:0.0:1789135924.781492:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135924.781495:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789135924.781500:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789135924.781508:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781513:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781520:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781525:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135924.781530:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781537:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781557:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d5e68400) 00010000:00010000:0.0:1789135924.781560:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135924.781564:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781570:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2bc1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135924.781586:0:6515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000009bdef6 reply state 0000000050802d0d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781595:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.781601:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a7d5e68c00) 00010000:00010000:0.0:1789135924.781603:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135924.781605:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789135924.781703:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:10766:x1876044644643072:12345-192.168.201.31@tcp:36:mkdir.0 Request processed in 1354us (1526us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789135924.781712:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:0.0:1789135924.800690:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.801065:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644643200 00000100:00100000:2.0:1789135924.801074:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644643200 00000100:00100000:2.0:1789135924.801189:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1789135924.801208:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:10767:x1876044644643200:12345-192.168.201.31@tcp:101:chmod.0 00010000:00010000:2.0:1789135924.801247:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135924.801274:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088dc expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.801342:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2bdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.801356:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.801367:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135924.801413:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789135924.801418:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135924.801460:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.801486:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088dc expref: 9 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.801505:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088dc expref: 8 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.801513:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135924.801515:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135924.801519:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94d800, rc 0) 00000100:00100000:2.0:1789135924.801644:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:10767:x1876044644643200:12345-192.168.201.31@tcp:101:chmod.0 Request processed in 445us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135924.801652:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:3.0:1789135924.817726:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.817909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644643456 00000100:00100000:2.0:1789135924.817922:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644643456 00000100:00100000:2.0:1789135924.817998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1789135924.818010:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:10767:x1876044644643456:12345-192.168.201.31@tcp:36:chmod.0 00010000:00010000:2.0:1789135924.818066:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135924.818288:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2bdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088dc expref: 8 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.818310:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135924.818322:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135924.818352:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.818365:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.818375:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135924.818696:0:6516:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b0dcc1da reply state 0000000053696ed6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.818711:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.818718:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:2.0:1789135924.818721:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789135924.818724:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789135924.818732:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789135924.818818:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+9:10767:x1876044644643456:12345-192.168.201.31@tcp:36:chmod.0 Request processed in 809us (1104us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789135924.818837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:0.0:1789135924.857749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.857897:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644643584 00000100:00100000:1.0:1789135924.857907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644643584 00000100:00100000:1.0:1789135924.857964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:1.0:1789135924.857974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:10768:x1876044644643584:12345-192.168.201.31@tcp:101:chown.0 00010000:00010000:1.0:1789135924.858012:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135924.858032:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.858095:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2bf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.858109:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.858121:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135924.858168:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789135924.858172:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135924.858227:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.858253:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088e3 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.858273:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088e3 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.858281:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:1.0:1789135924.858284:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135924.858288:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135924.858346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+10:10768:x1876044644643584:12345-192.168.201.31@tcp:101:chown.0 Request processed in 373us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.858356:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:0.0:1789135924.862129:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.862354:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644643712 00000100:00100000:1.0:1789135924.862363:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644643712 00000100:00100000:1.0:1789135924.862460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1789135924.862471:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+10:10768:x1876044644643712:12345-192.168.201.31@tcp:101:chown.0 00010000:00010000:1.0:1789135924.862491:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135924.862514:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862580:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862592:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862601:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862609:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862613:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862617:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862769:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862777:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862803:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135924.862843:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789135924.862893:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135924.862915:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862929:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862936:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862942:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862948:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135924.862952:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862960:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862973:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:1.0:1789135924.862976:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135924.862981:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.862987:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863012:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863018:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863023:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863028:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135924.863031:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863037:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863045:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a7d5e68c00) 00010000:00010000:1.0:1789135924.863047:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135924.863050:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863055:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863417:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ea expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863437:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ea expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.863456:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:1.0:1789135924.863459:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135924.863462:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:0.0:1789135924.863769:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+11:10768:x1876044644643712:12345-192.168.201.31@tcp:101:chown.0 Request processed in 1299us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135924.863777:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:3.0:1789135924.868367:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.868713:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644643840 00000100:00100000:1.0:1789135924.868726:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644643840 00000100:00100000:1.0:1789135924.868805:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1789135924.868819:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:50163b70-8f7a-42d3-bcbf-652648370aa8+11:10768:x1876044644643840:12345-192.168.201.31@tcp:900:chown.0 00000100:00100000:1.0:1789135924.868991:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:50163b70-8f7a-42d3-bcbf-652648370aa8+11:10768:x1876044644643840:12345-192.168.201.31@tcp:900:chown.0 Request processed in 175us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.868998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:3.0:1789135924.873468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.873615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644644096 00000100:00100000:1.0:1789135924.873625:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644644096 00000100:00100000:1.0:1789135924.873683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:1.0:1789135924.873690:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+11:10768:x1876044644644096:12345-192.168.201.31@tcp:36:chown.0 00010000:00010000:1.0:1789135924.873739:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135924.873763:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ea expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.873778:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:1.0:1789135924.873781:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135924.873799:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.873809:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.873831:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135924.877555:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1789135924.877686:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877705:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877710:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877714:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135924.877717:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877723:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877737:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a7d5e68c00) 00010000:00010000:0.0:1789135924.877739:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135924.877742:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877746:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2bc8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877763:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877767:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877771:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877773:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135924.877778:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877782:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877787:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:0.0:1789135924.877788:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135924.877790:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877793:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2bcf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877803:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877806:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877809:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877812:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135924.877813:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877817:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877821:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:0.0:1789135924.877823:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135924.877828:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.877832:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2be4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135924.878480:0:6517:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bbd058e7 reply state 00000000cd953501 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.878494:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.878499:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:2.0:1789135924.878500:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789135924.878503:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789135924.878514:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1789135924.878673:0:6517:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789135924.878713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:10768:x1876044644644096:12345-192.168.201.31@tcp:36:chown.0 Request processed in 5019us (5251us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789135924.878720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00010000:00010000:0.0:1789135924.886341:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.886363:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.886370:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.886377:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135924.886381:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.886389:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.886410:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:0.0:1789135924.886414:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135924.886419:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.886811:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879800/0x559c8745c6de2c15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135924.906357:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.906779:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644644224 00000100:00100000:2.0:1789135924.906790:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644644224 00000100:00100000:0.0:1789135924.906900:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789135924.906912:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:10769:x1876044644644224:12345-192.168.201.31@tcp:101:touch.500 00010000:00010000:3.0:1789135924.907153:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135924.907197:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f200/0x559c8745c6de2c1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135924.909030:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1780us 00010000:00010000:2.0:1789135924.934505:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934529:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934542:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934559:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934566:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934586:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934728:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2c31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934737:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934745:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135924.934777:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789135924.934781:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135924.934821:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934833:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934840:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934890:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934897:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135924.934902:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934909:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934930:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:2.0:1789135924.934933:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135924.934939:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934945:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934956:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934963:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934969:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934975:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135924.934977:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.934995:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.935002:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135924.935005:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135924.935008:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.935014:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.935064:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f200/0x559c8745c6de2c1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088f1 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.935080:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2c31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088f1 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.935087:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135924.935089:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789135924.935092:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94d600, rc 0) 00000100:00100000:2.0:1789135924.935163:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:10769:x1876044644644224:12345-192.168.201.31@tcp:101:touch.500 Request processed in 28252us (28816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135924.935172:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789135924.957290:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.961440:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644644480 00000100:00100000:2.0:1789135924.961456:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644644480 00000100:00100000:2.0:1789135924.961530:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:2.0:1789135924.961541:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:10769:x1876044644644480:12345-192.168.201.31@tcp:101:touch.500 00010000:00010000:2.0:1789135924.961566:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135924.961590:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c38 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088f8 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.961704:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.961715:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.961725:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.961800:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.961808:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.961815:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135924.962305:0:8299:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789135924.962417:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2c4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962424:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2c4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962429:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2c4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962456:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962461:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962465:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962469:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135924.962472:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962485:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962494:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135924.962496:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135924.962499:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962503:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135924.962514:0:8299:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e14d19f9 reply state 000000007b528a4c transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962521:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962525:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135924.962526:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789135924.962528:0:8299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789135924.962554:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088f8 expref: 10 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962562:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2c4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088f8 expref: 9 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135924.962567:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa7c3800) 00010000:00010000:2.0:1789135924.962568:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135924.962569:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94cc00, rc 0) 00000100:00100000:2.0:1789135924.962637:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+10:10769:x1876044644644480:12345-192.168.201.31@tcp:101:touch.500 Request processed in 1098us (5355us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789135924.962652:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789135924.973207:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135924.974320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644644736 00000100:00100000:0.0:1789135924.974332:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644644736 00000100:00100000:0.0:1789135924.974402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1789135924.974412:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+10:10769:x1876044644644736:12345-192.168.201.31@tcp:36:touch.500 00010000:00010000:0.0:1789135924.974471:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135924.974499:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2c4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088f8 expref: 10 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.974519:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa7c3800) 00010000:00010000:0.0:1789135924.974529:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135924.974586:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.974601:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.974611:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135924.974719:0:6516:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c43ab977 reply state 00000000e2e8ac36 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.974732:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135924.974738:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:0.0:1789135924.974741:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135924.974743:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135924.974886:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+11:10769:x1876044644644736:12345-192.168.201.31@tcp:36:touch.500 Request processed in 474us (1689us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789135924.974894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1789135924.982657:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135924.982735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644644864 00000100:00100000:1.0:1789135924.982746:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644644864 00000100:00100000:1.0:1789135924.982808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:1.0:1789135924.982818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+11:10769:x1876044644644864:12345-192.168.201.31@tcp:101:touch.500 00010000:00010000:1.0:1789135924.982874:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135924.982900:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab088ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.982958:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ff expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.982970:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ff expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135924.982988:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:1.0:1789135924.982992:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135924.982997:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135924.983066:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+12:10769:x1876044644644864:12345-192.168.201.31@tcp:101:touch.500 Request processed in 250us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135924.983073:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1789135924.989818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.990021:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644644992 00000100:00100000:2.0:1789135924.990031:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644644992 00000100:00100000:2.0:1789135924.990081:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1789135924.990089:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876044644644992:12345-192.168.201.31@tcp:8:touch.500 00010000:00080000:2.0:1789135924.990127:0:8430:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1789135924.990157:0:8430:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de2c69 00002000:00100000:2.0:1789135924.990170:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 50163b70-8f7a-42d3-bcbf-652648370aa8/ffff90a7ff5b4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135924.990187:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135924.990280:0:8430:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789135924.990312:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90a7ff5b6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135924.990386:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644644992:12345-192.168.201.31@tcp:8:touch.500 Request processed in 295us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135924.990394:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:3.0:1789135924.998411:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135924.999229:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644645120 00000100:00100000:2.0:1789135924.999242:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644645120 00000100:00100000:2.0:1789135924.999400:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1789135924.999412:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644645120:12345-192.168.201.31@tcp:2:touch.500 00000001:00080000:0.0:1789135925.002428:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1789135925.002442:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000100:00080000:1.0:1789135925.002611:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135925.002832:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:0:x1876044644645120:12345-192.168.201.31@tcp:2:touch.500 Request processed in 3418us (4428us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789135925.002870:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:3.0:1789135925.014466:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135925.014572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644645376 00000100:00100000:0.0:1789135925.014582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644645376 00000100:00100000:0.0:1789135925.014642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1789135925.014651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+12:10769:x1876044644645376:12345-192.168.201.31@tcp:35:touch.500 00000100:00100000:0.0:1789135925.014977:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+13:10769:x1876044644645376:12345-192.168.201.31@tcp:35:touch.500 Request processed in 326us (520us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789135925.014994:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1789135925.037771:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135925.038110:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644645504 00000100:00100000:3.0:1789135925.038121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644645504 00000100:00100000:2.0:1789135925.038569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789135925.038582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+13:10770:x1876044644645504:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:2.0:1789135925.038608:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135925.038643:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08906 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.038711:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.038726:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.038738:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135925.038784:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789135925.038788:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135925.038832:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.038895:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08906 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.038914:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08906 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.038922:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135925.038925:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135925.038928:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94d800, rc 0) 00000100:00100000:2.0:1789135925.039121:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+14:10770:x1876044644645504:12345-192.168.201.31@tcp:101:rm.0 Request processed in 540us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135925.039128:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:3.0:1789135925.050481:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135925.050613:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644645760 00000100:00100000:1.0:1789135925.050623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644645760 00000100:00100000:1.0:1789135925.050683:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1789135925.050709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6683840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+14:10770:x1876044644645760:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:1.0:1789135925.050731:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135925.050752:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0890d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135925.050954:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789135925.051121:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0890d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.051136:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:1.0:1789135925.051139:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135925.051144:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878200/0x559c8745c6de2c7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0890d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.051158:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878200, rc 0) 00000100:00100000:1.0:1789135925.051484:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6683840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+15:10770:x1876044644645760:12345-192.168.201.31@tcp:101:rm.0 Request processed in 776us (1011us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789135925.051492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:0.0:1789135925.055940:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135925.056297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644645888 00000100:00100000:3.0:1789135925.056321:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644645888 00000100:00100000:3.0:1789135925.056383:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:3.0:1789135925.056396:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+15:10770:x1876044644645888:12345-192.168.201.31@tcp:37:rm.0 00000100:00100000:3.0:1789135925.064552:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+15:10770:x1876044644645888:12345-192.168.201.31@tcp:37:rm.0 Request processed in 8148us (8614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135925.064566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:0.0:1789135925.073644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135925.073792:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644646144 00000100:00100000:1.0:1789135925.073802:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644646144 00000100:00100000:0.0:1789135925.078554:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:0.0:1789135925.078570:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+15:10770:x1876044644646144:12345-192.168.201.31@tcp:35:rm.0 00000100:00100000:0.0:1789135925.078820:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+16:10770:x1876044644646144:12345-192.168.201.31@tcp:35:rm.0 Request processed in 252us (5185us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789135925.078828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:0.0:1789135925.086590:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135925.086707:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644646400 00000100:00100000:2.0:1789135925.086730:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644646400 00000100:00100000:2.0:1789135925.086795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1789135925.086805:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+16:10770:x1876044644646400:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:2.0:1789135925.086831:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135925.086905:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08914 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.087444:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94ce00/0x559c8745c6de2c93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.087459:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94ce00/0x559c8745c6de2c93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.087470:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94ce00/0x559c8745c6de2c93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135925.087480:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789135925.087586:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2c8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08914 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.087606:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94ce00/0x559c8745c6de2c93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08914 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.087615:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135925.087618:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135925.087622:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94ce00, rc 0) 00000100:00100000:2.0:1789135925.087737:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644646400:12345-192.168.201.31@tcp:101:rm.0 Request processed in 933us (1157us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789135925.087746:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:1.0:1789135925.092503:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135925.092596:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644646528 00000100:00100000:2.0:1789135925.092608:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644646528 00000100:00100000:2.0:1789135925.092688:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:2.0:1789135925.092699:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644646528:12345-192.168.201.31@tcp:41:rm.0 00000004:00000024:2.0:1789135925.092756:0:8299:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789135925.092821:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2311a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644646528:12345-192.168.201.31@tcp:41:rm.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135925.092829:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:0.0:1789135925.095684:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135925.095967:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644646656 00000100:00100000:2.0:1789135925.095978:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644646656 00000100:00100000:2.0:1789135925.096079:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:2.0:1789135925.096091:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644646656:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:2.0:1789135925.096116:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135925.096144:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2ca1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0891b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096222:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096238:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096249:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096261:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096268:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096292:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096384:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096393:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096400:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135925.096437:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789135925.096441:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135925.096458:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096468:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096474:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096478:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096483:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096487:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135925.096490:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096501:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096511:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135925.096513:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135925.096516:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096520:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d000/0x559c8745c6de2ca8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096540:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096544:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096548:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096551:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94c600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135925.096552:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096556:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096559:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135925.096561:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135925.096562:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096573:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c600/0x559c8745c6de2caf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096592:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d200/0x559c8745c6de2ca1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0891b expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096600:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0891b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.096605:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:2.0:1789135925.096607:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135925.096609:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ef94dc00, rc 0) 00000100:00100000:2.0:1789135925.096814:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:10770:x1876044644646656:12345-192.168.201.31@tcp:101:rm.0 Request processed in 725us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135925.096822:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:1.0:1789135925.104475:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135925.104539:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644646912 00000100:00100000:2.0:1789135925.104550:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644646912 00000100:00100000:2.0:1789135925.104626:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:2.0:1789135925.104636:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+19:10770:x1876044644646912:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:2.0:1789135925.104696:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789135925.104728:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94dc00/0x559c8745c6de2cb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0891b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104752:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2c62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ff expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104783:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:2.0:1789135925.104796:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d800/0x559c8745c6de2c77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08906 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104805:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135925.104808:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135925.104827:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104840:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104884:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104896:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104904:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.104910:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105041:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105051:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105067:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135925.105324:0:8299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789135925.105334:0:8299:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373224478698ns, next at 374224476923ns, rc = 0 00010000:00010000:2.0:1789135925.105379:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105388:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105396:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105403:0:8299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105410:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.105416:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106162:0:8299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789135925.106190:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106197:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106212:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106232:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135925.106238:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106246:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106260:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:2.0:1789135925.106263:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789135925.106268:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106274:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de2ccb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106301:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106307:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106313:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106317:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94cc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135925.106319:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106325:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106342:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135925.106344:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135925.106347:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106352:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94cc00/0x559c8745c6de2cbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135925.106362:0:8299:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fc439f95 reply state 0000000000a2abb1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106373:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135925.106380:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135925.106381:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789135925.106385:0:8299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135925.106491:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644646912:12345-192.168.201.31@tcp:36:rm.0 Request processed in 1851us (2019us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789135925.106499:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00010000:00010000:0.0:1789135925.106815:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135925.106823:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.106836:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4e00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135925.106839:0:13980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.106948:0:13980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.106958:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:0.0:1789135925.106960:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789135925.106963:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.106969:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de2cd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.107769:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135925.107773:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135925.107774:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135925.113033:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135925.113105:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644647168 00000100:00100000:3.0:1789135925.113116:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644647168 00000100:00100000:3.0:1789135925.113222:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1789135925.113233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644647168:12345-192.168.201.31@tcp:35:rm.0 00000100:00100000:3.0:1789135925.113512:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:10770:x1876044644647168:12345-192.168.201.31@tcp:35:rm.0 Request processed in 280us (488us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789135925.113520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1789135925.119695:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135925.119750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644647424 00000100:00100000:0.0:1789135925.119761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644647424 00000100:00100000:0.0:1789135925.119822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1789135925.119833:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6682580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:10770:x1876044644647424:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:0.0:1789135925.119944:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789135925.119976:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94ce00/0x559c8745c6de2c93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08914 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120119:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94d600/0x559c8745c6de2c31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088f1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120131:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:0.0:1789135925.120148:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2bf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088e3 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120243:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa7c3500) 00010000:00010000:0.0:1789135925.120255:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135925.120451:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120465:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120475:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120489:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120496:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135925.120502:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.123512:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.123616:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.123630:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135925.124059:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789135925.124414:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124590:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124598:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124604:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135925.124608:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124616:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124629:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90a7fa59f700) 00010000:00010000:1.0:1789135925.124632:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135925.124637:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124644:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2ce7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124674:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124691:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124697:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124702:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135925.124705:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124711:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124720:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa59f300) 00010000:00010000:1.0:1789135925.124722:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135925.124725:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124731:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2cd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135925.124747:0:6516:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000021f842a4 reply state 00000000830e9611 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124759:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135925.124765:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a7fa59f200) 00010000:00010000:1.0:1789135925.124768:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135925.124771:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135925.125023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6682580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:10770:x1876044644647424:12345-192.168.201.31@tcp:36:rm.0 Request processed in 5187us (5330us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789135925.125039:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00010000:00010000:3.0:1789135925.481670:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135926.504077:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135927.528985:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135927.656133:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135927.656157:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666766208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135927.656263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135927.656332:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766208 00000100:00100000:1.0:1789135927.656339:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766208 00000100:00100000:1.0:1789135927.656396:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789135927.656406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666766208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135927.656441:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135927.656486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666766208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135927.656492:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789135927.656535:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666766208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135928.168475:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789135928.168498:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666766336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135928.168585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.168650:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666766464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135928.168690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.168726:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766336 00000100:00100000:2.0:1789135928.168733:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766336 00000100:00100000:2.0:1789135928.168778:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766464 00000100:00100000:2.0:1789135928.168798:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766464 00000100:00100000:2.0:1789135928.168824:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789135928.168832:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666766336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135928.168904:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135928.168947:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666766336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.168955:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789135928.168972:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789135928.168979:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666766464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135928.168988:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135928.169013:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666766464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.169019:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789135928.169035:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789135928.169062:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e803c0 x1876044666766464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135928.169080:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666766464:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789135928.169106:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82580 x1876044666766336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135928.169117:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666766336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135928.170165:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666766592:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170263:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666767104:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170317:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666767616:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170366:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789135928.170372:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666766976:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170409:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666767488:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170452:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767104 00000100:00100000:2.0:1789135928.170458:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767104 00000100:00100000:2.0:1789135928.170503:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135928.170511:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666767104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170568:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666767104:12345-0@lo:400:kworker.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.170576:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135928.170598:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767616 00000100:00100000:2.0:1789135928.170601:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767616 00000100:00100000:2.0:1789135928.170632:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766976 00000100:00100000:2.0:1789135928.170635:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766976 00000100:00100000:2.0:1789135928.170646:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767488 00000100:00100000:2.0:1789135928.170648:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767488 00000100:00100000:2.0:1789135928.170659:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789135928.170665:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666767616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170694:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666767616:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.170700:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789135928.170711:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789135928.170716:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666766976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170753:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666766976:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.170759:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789135928.170773:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789135928.170781:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666767488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170817:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666767488:12345-0@lo:400:kworker.0 Request processed in 38us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.170823:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:2.0:1789135928.170843:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135928.170847:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135928.170877:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170903:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170921:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666767232:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170941:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170956:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666767744:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.170978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.170994:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789135928.171000:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666766848:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.171051:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666767360:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171073:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.171083:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666767872:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171118:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.171144:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767744 00000100:00100000:2.0:1789135928.171148:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767744 00000100:00100000:2.0:1789135928.171191:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767872 00000100:00100000:2.0:1789135928.171195:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767872 00000100:00100000:2.0:1789135928.171216:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789135928.171222:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666767744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171256:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666767744:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.171262:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789135928.171275:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789135928.171281:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666767872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171306:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666767872:12345-0@lo:400:kworker.0 Request processed in 26us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.171311:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789135928.171328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766848 00000100:00100000:2.0:1789135928.171330:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766848 00000100:00100000:2.0:1789135928.171351:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135928.171356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666766848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666766848:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.171389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135928.171471:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766720 00000100:00100000:2.0:1789135928.171475:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766720 00000100:00100000:2.0:1789135928.171492:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767232 00000100:00100000:2.0:1789135928.171494:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767232 00000100:00100000:2.0:1789135928.171507:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666767360 00000100:00100000:2.0:1789135928.171510:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666767360 00000100:00100000:2.0:1789135928.171521:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789135928.171526:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666766720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171554:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666766720:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.171566:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789135928.171579:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789135928.171585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666767232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171613:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666767232:12345-0@lo:400:kworker.0 Request processed in 30us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.171619:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789135928.171630:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789135928.171635:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666767360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171662:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666767360:12345-0@lo:400:kworker.0 Request processed in 27us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.171667:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1789135928.171681:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135928.171684:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135928.171686:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135928.171716:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666766976:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171727:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666767488:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171735:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666767104:0@lo:400:kworker.0 00010000:00080000:2.0:1789135928.171747:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c446e1c0 x1876044666767616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135928.171757:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666767616:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171800:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666766848:0@lo:400:kworker.0 00010000:00080000:2.0:1789135928.171810:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c446c780 x1876044666767360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135928.171829:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666767360:0@lo:400:kworker.0 00010000:00080000:2.0:1789135928.171840:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c446f480 x1876044666767872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135928.171847:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666767872:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171875:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789135928.171886:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666767232:0@lo:400:kworker.0 00010000:00080000:2.0:1789135928.171893:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c446c3c0 x1876044666767744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135928.171900:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666767744:0@lo:400:kworker.0 00000100:00100000:0.0:1789135928.172091:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666766592 00000100:00100000:0.0:1789135928.172097:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666766592 00000100:00100000:0.0:1789135928.172127:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1789135928.172134:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666766592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135928.172176:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666766592:12345-0@lo:400:kworker.0 Request processed in 42us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135928.172182:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789135928.172294:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666766592:0@lo:400:kworker.0 00010000:00010000:3.0:1789135928.552502:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789135928.680499:0:9964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376799641812ns, next at 377799638773ns, rc = 0 00000100:00100000:0.0:1789135928.680679:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666768000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135928.680819:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.681237:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768000 00000100:00100000:2.0:1789135928.681244:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768000 00000100:00100000:2.0:1789135928.681302:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789135928.681312:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666768000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135928.681342:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135928.681396:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666768000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.681403:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1789135928.681538:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c449b480 x1876044666768000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135928.681564:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666768000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135928.681797:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666768128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135928.681843:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135928.682007:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768128 00000100:00100000:2.0:1789135928.682022:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768128 00000100:00100000:2.0:1789135928.682058:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789135928.682076:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666768128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135928.682088:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135928.682120:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666768128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135928.682127:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1789135928.682329:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c449b840 x1876044666768128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135928.682344:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666768128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135929.196939:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135929.196970:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666768256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135929.197044:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135929.197637:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768256 00000100:00100000:3.0:1789135929.197655:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768256 00000100:00100000:1.0:1789135929.200871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789135929.200893:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666768256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135929.201638:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135929.203103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666768256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2203us (6044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135929.203140:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789135929.203342:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666768256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135929.576044:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135929.846905:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135929.847176:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644647552 00000100:00100000:0.0:1789135929.847186:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644647552 00000100:00100000:0.0:1789135929.847238:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 413 00000100:00100000:0.0:1789135929.847248:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644647552:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135929.847330:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644647552:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 84us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135929.847338:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 413 00000100:00100000:1.0:1789135929.852383:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135929.852513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644647808 00000100:00100000:2.0:1789135929.852525:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644647808 00000100:00100000:2.0:1789135929.852606:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 291 00000100:00100000:2.0:1789135929.852616:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644647808:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135929.852689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644647808:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135929.852698:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 291 00000100:00080000:3.0:1789135929.853454:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135929.855813:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135929.855848:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135929.855904:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135929.856179:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648064 00000100:00100000:2.0:1789135929.856188:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648064 00000100:00100000:2.0:1789135929.856251:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644647680 00000100:00100000:2.0:1789135929.856255:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644647680 00000100:00100000:2.0:1789135929.856286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 292 00000100:00100000:2.0:1789135929.856296:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644648064:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135929.856385:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644648064:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 91us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135929.856393:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 292 00000100:00100000:2.0:1789135929.856412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 293 00000100:00100000:2.0:1789135929.856417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6680b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:2392:x1876044644647680:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135929.856447:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6680b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:2392:x1876044644647680:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135929.856469:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 293 00000100:00100000:2.0:1789135929.856489:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644647936 00000100:00100000:2.0:1789135929.856493:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644647936 00000100:00100000:2.0:1789135929.856524:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:2.0:1789135929.856542:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644647936:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135929.856570:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6681680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644647936:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 41us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135929.856577:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00080000:3.0:1789135929.858023:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135929.858032:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135929.873543:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135929.873677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648192 00000100:00100000:3.0:1789135929.873688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648192 00000100:00100000:3.0:1789135929.873780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 294 00000100:00080000:2.0:1789135929.873780:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135929.873791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644648192:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135929.873904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644648192:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 115us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135929.873913:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 294 00000001:02000400:0.0:1789135930.026334:0:14379:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789135930.600129:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789135930.737763:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789135930.738112:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1789135930.738123:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789135930.738157:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738168:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738176:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738182:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94c400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135930.738186:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738194:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738211:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135930.738227:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135930.738233:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738239:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94c400/0x559c8745c6de2c46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738260:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738267:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738272:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738276:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135930.738279:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738284:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738291:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90a7fa59fa00) 00010000:00010000:2.0:1789135930.738294:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135930.738297:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738302:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2c5b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738319:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738334:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738340:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738345:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94da00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135930.738348:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738354:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738362:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135930.738364:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135930.738366:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738371:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ef94da00/0x559c8745c6de2cc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738387:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738393:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738398:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738414:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135930.738423:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738429:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738437:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90a7fa59f200) 00010000:00010000:2.0:1789135930.738439:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135930.738442:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135930.738447:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ce0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135930.743208:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666768384:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789135930.743295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135930.744110:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768384 00000100:00100000:1.0:1789135930.744120:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768384 00000100:00100000:1.0:1789135930.744193:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789135930.744205:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666768384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789135930.744238:0:8432:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1789135930.744286:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa40c34, atime: 0x6aa40c34, ctime: 0x6aa40c34, blocks: 0x0 00010000:00010000:1.0:1789135930.744293:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.744311:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1789135930.744315:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135930.744322:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.744339:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.744349:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.744356:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.744376:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789135930.748616:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789135930.750232:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666768384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6022us (6928us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789135930.750247:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789135930.750289:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135930.750298:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.750310:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135930.750315:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.750327:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.750347:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.750356:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de2cee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135930.750384:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135930.750385:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135930.750387:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789135930.750599:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a6c44b7480/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789135930.750607:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666768384:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1789135931.336373:0:14428:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf0720ce0 20000000:00000080:2.0:1789135931.336396:0:14428:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a6c3da3c00 uarg=0000000000000000 20000000:01000000:2.0:1789135931.336459:0:14428:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789135931.336466:0:14428:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789135931.336471:0:14428:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789135931.338934:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 20000000:02000000:3.0:1789135931.339102:0:14428:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789135931.348032:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 224 off10720 00000040:00080000:3.0:1789135931.348073:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 128 off10848 00000040:00080000:3.0:1789135931.348090:0:14428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off11072 10000000:01000000:3.0:1789135931.348106:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789135931.348127:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348144:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348155:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348176:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348182:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348189:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2bac expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348196:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348203:0:14428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348245:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348260:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 12 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.348276:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6682d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768512:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135931.348409:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2bac expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348418:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2bac expref: 23 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.348427:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6681e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768640:0@lo:104: 00000100:00100000:3.0:1789135931.348483:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135931.348530:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348540:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 23 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.348549:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6680f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768768:0@lo:104: 00000100:00100000:3.0:1789135931.348572:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789135931.348602:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348610:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 23 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.348618:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768896:0@lo:104: 00000100:00100000:3.0:1789135931.348642:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135931.348664:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768640 00000100:00100000:1.0:1789135931.348674:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768640 00010000:00010000:3.0:1789135931.348679:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.348689:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.348700:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666769024:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135931.348703:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768768 00000100:00100000:0.0:1789135931.348709:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768768 00000100:00100000:1.0:1789135931.348715:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666768896 00000100:00100000:1.0:1789135931.348718:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666768896 00000100:00100000:1.0:1789135931.348813:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789135931.348826:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6682940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+5:14428:x1876044666768640:12345-0@lo:104: 00010000:00010000:1.0:1789135931.348847:0:10335:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.348923:0:10335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789135931.348930:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6682940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+5:14428:x1876044666768640:12345-0@lo:104: Request processed in 108us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.349618:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789135931.349633:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6680780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:14428:x1876044666768896:12345-0@lo:104: 00010000:00010000:0.0:1789135931.349644:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349695:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789135931.349700:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6680780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+5:14428:x1876044666768896:12345-0@lo:104: Request processed in 74us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.349707:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789135931.349751:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789135931.349757:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:14428:x1876044666768768:12345-0@lo:104: 00010000:00010000:0.0:1789135931.349764:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349794:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789135931.349799:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+4:14428:x1876044666768768:12345-0@lo:104: Request processed in 43us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.349813:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1789135931.349833:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789135931.349839:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349847:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135931.349851:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349874:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135931.349881:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135931.349888:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135931.349918:0:13980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349924:0:13980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135931.349941:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349949:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031800/0x559c8745c6de2bac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2bb3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349964:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789135931.349967:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349982:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94ca00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135931.349985:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.349993:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135931.349999:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135931.350004:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135931.350015:0:13980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350020:0:13980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135931.350025:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350031:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ef94ca00/0x559c8745c6de2b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350040:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135931.350043:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350049:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135931.350051:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350066:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135931.350073:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135931.350078:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135931.350087:0:13980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350092:0:13980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135931.350104:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350110:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de2b9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2ba5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.350119:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135931.350120:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135931.350122:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135931.350133:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666769280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135931.350164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135931.350196:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135931.350201:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666769152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135931.350230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135931.350246:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135931.350252:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666769408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135931.350269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135931.350296:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769280 00000100:00100000:0.0:1789135931.350301:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769280 00010000:00010000:0.0:1789135931.350917:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 24 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135931.350944:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769152 00000100:00100000:0.0:1789135931.350947:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769152 00010000:00010000:0.0:1789135931.350957:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2bac expref: 25 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135931.350969:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769408 00000100:00100000:0.0:1789135931.350971:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769408 00010000:00010000:0.0:1789135931.350980:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 26 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135931.350991:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135931.350997:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3641:x1876044666769280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135931.351008:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135931.351013:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 26 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.351022:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 26 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.351040:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135931.351072:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+26:3641:x1876044666769280:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.351078:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789135931.351091:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789135931.351096:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3641:x1876044666769152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135931.351113:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135931.351117:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2bac expref: 25 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.351126:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2bac expref: 25 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.351135:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135931.351153:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+25:3641:x1876044666769152:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.351159:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789135931.351199:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789135931.351204:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666769408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135931.351210:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135931.351214:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 24 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.351223:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 24 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.351231:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135931.351251:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666769408:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.351257:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789135931.351298:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666769408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135931.351647:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666769152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135931.351655:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666769280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135931.352933:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135931.352940:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135931.353107:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:3.0:1789135931.359204:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.359224:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 23 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135931.359235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135931.359258:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66821c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666769536:0@lo:104: 00000100:00100000:0.0:1789135931.359302:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648320 00000100:00100000:0.0:1789135931.359311:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648320 00000100:00100000:3.0:1789135931.359329:0:14428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135931.359361:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 13 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.359363:0:14428:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad900 going to sleep for 11 seconds 00000100:00100000:3.0:1789135931.359391:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6682d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768512:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135931.359406:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00010000:00010000:3.0:1789135931.359407:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94c000/0x559c8745c6de2bb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2bac expref: 23 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135931.359420:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644648320:12345-192.168.201.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789135931.359426:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6681e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768640:0@lo:104: 00010000:00010000:0.0:1789135931.359436:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135931.359438:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94de00/0x559c8745c6de2ba5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b9e expref: 22 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.359447:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 13 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.359450:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6680f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768768:0@lo:104: 00010000:00010000:3.0:1789135931.359466:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2b97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b90 expref: 21 pid: 6508 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.359470:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 13 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135931.359480:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666768896:0@lo:104: 00010000:00010000:0.0:1789135931.359496:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de2bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088d5 expref: 13 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.359513:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135931.359561:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f56ac69e-f262-403a-94d3-403db5052814+12:2392:x1876044644648320:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 145us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.359569:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:2.0:1789135931.359999:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769536 00000100:00100000:2.0:1789135931.360005:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769536 00000100:00100000:2.0:1789135931.360044:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789135931.360051:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:14428:x1876044666769536:12345-0@lo:104: 00010000:00010000:2.0:1789135931.360072:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135931.360128:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789135931.360135:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:44af6ea5-156e-4935-ba38-1972bb1ada25+3:14428:x1876044666769536:12345-0@lo:104: Request processed in 85us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135931.360142:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1789135931.360231:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135931.360238:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360247:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789135931.360251:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360267:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789135931.360274:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135931.360280:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789135931.360329:0:13980:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360346:0:13980:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789135931.360369:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360376:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031200/0x559c8745c6de2b7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de2b82 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360392:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135931.360394:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135931.360395:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135931.360410:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666769664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789135931.360450:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135931.360506:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769664 00000100:00100000:0.0:1789135931.360510:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769664 00000100:00100000:3.0:1789135931.360521:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66821c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666769536:0@lo:104: 00010000:00010000:0.0:1789135931.360536:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 21 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135931.360568:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789135931.360575:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3639:x1876044666769664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789135931.360593:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135931.360598:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 21 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360607:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 21 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360618:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878800/0x559c8745c6de2b82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de2b7b expref: 21 pid: 6509 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.360628:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135931.360656:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3639:x1876044666769664:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135931.360662:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789135931.360687:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666769664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789135931.361719:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14428:1876044666769024:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135931.361767:0:14428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135931.387922:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135931.388199:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648448 00000100:00100000:1.0:1789135931.388209:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648448 00010000:00010000:1.0:1789135931.388252:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135931.388294:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:1.0:1789135931.388305:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4499680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+12:2391:x1876044644648448:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135931.388319:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135931.388325:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388338:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388357:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030800/0x559c8745c6de2b89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab088ce expref: 12 pid: 6509 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388375:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388382:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388419:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388426:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388433:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388439:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388446:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135931.388450:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388458:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388479:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135931.388491:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135931.388549:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4499680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+11:2391:x1876044644648448:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 245us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135931.388557:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00010000:00010000:3.0:1789135931.389064:0:14428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.389075:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135931.389094:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de2cf5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135931.633215:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789135932.292587:0:14477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffccd95130 20000000:00000080:3.0:1789135932.292607:0:14477:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a6c4530400 uarg=0000000000000000 20000000:01000000:3.0:1789135932.292688:0:14477:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789135932.292694:0:14477:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789135932.292698:0:14477:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1789135932.293272:0:14478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 16 count 16 20000000:02000000:0.0:1789135932.293338:0:14477:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789135932.293416:0:14477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11296 00000040:00080000:0.0:1789135932.293439:0:14477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 128 off11424 00000040:00080000:0.0:1789135932.293448:0:14477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11648 10000000:01000000:0.0:1789135932.293457:0:14477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789135932.293476:0:14477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293590:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293600:0:14477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293617:0:14477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293622:0:14477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293626:0:14477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293630:0:14477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135932.293633:0:14477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293638:0:14477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293647:0:14477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293652:0:14477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.293657:0:14477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031400/0x559c8745c6de2cfc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.648190:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789135932.652338:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789135932.652346:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c2291000 from 13 10000000:01000000:1.0:1789135932.652352:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789135932.652606:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.652632:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.652644:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135932.652670:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666769792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789135932.652753:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135932.652809:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135932.652836:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769792 00000100:00100000:1.0:1789135932.652843:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769792 00000100:00100000:1.0:1789135932.652919:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789135932.652928:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+20:6513:x1876044666769792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789135932.654551:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135932.654577:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879800/0x559c8745c6de2d0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2d03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.654607:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879800/0x559c8745c6de2d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2d03 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.654618:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879800/0x559c8745c6de2d0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2d03 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135932.654627:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879800, rc 0) 00000100:00100000:1.0:1789135932.654702:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666769792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1774us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.654719:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789135932.656564:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666769792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135932.656595:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.656607:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135932.656696:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666769920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135932.656765:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.656811:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135932.658895:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666769920 00000100:00100000:0.0:1789135932.658909:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666769920 00000100:00100000:0.0:1789135932.658981:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789135932.658992:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666769920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.659188:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666769920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.659196:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789135932.659526:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666769920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135932.659579:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135932.659646:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135932.659692:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135932.660534:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770048 00000100:00100000:0.0:1789135932.660542:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770048 00000100:00100000:0.0:1789135932.660584:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1789135932.660592:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666770048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.660723:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666770048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.660731:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789135932.660842:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135932.663220:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14490:1876044666770176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135932.663308:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135932.663361:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886600 going to sleep for 11 seconds 00000100:00100000:0.0:1789135932.663634:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770176 00000100:00100000:0.0:1789135932.663641:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770176 00000100:00100000:0.0:1789135932.663698:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1789135932.663717:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14490:x1876044666770176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135932.663933:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14490:x1876044666770176:12345-0@lo:502:llog_process_th.0 Request processed in 225us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.663951:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789135932.668725:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14490:1876044666770176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135932.668781:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135932.668796:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.668799:0:14490:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789135932.668806:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c2291000 00000020:00000080:3.0:1789135932.668809:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135932.669727:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135932.669733:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.669735:0:14490:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789135932.669739:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135932.669743:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.669744:0:14490:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789135932.669748:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c2291000 00000020:00000080:3.0:1789135932.669750:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135932.677837:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14490:1876044666770304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.677973:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.678020:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.678109:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770304 00000100:00100000:3.0:1789135932.678117:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770304 00000100:00100000:3.0:1789135932.678165:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789135932.678174:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14490:x1876044666770304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.678294:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+21:14490:x1876044666770304:12345-0@lo:502:llog_process_th.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.678303:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789135932.678362:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14490:1876044666770304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135932.678407:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135932.678415:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.678418:0:14490:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789135932.678422:0:14490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789135932.678509:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789135932.678535:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135932.678547:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.678558:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135932.678569:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135932.678572:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7e761a000 from 13 10000000:01000000:3.0:1789135932.678575:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135932.678603:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.678610:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.678619:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.678643:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.678673:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.678692:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.678793:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770432 00000100:00100000:3.0:1789135932.678797:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770432 00000100:00100000:3.0:1789135932.678821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789135932.678828:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:6513:x1876044666770432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135932.678837:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135932.678849:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de2d18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2d11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.678905:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de2d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2d11 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.678915:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de2d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2d11 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.678923:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ec00, rc 0) 00000100:00100000:3.0:1789135932.678952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d895f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666770432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.678959:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789135932.678995:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135932.679008:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.679016:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.679073:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.679097:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.679120:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.679131:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770560 00000100:00100000:3.0:1789135932.679134:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770560 00000100:00100000:3.0:1789135932.679154:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789135932.679159:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666770560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.679241:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666770560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.679248:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789135932.679276:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.679300:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.679332:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.679343:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.679353:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770688 00000100:00100000:3.0:1789135932.679356:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770688 00000100:00100000:3.0:1789135932.679374:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789135932.679379:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666770688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.679446:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de641850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666770688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.679452:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789135932.679489:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666770688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.679661:0:14491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14491:1876044666770816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.679700:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.679735:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770816 00000100:00100000:3.0:1789135932.679739:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770816 00000100:00100000:3.0:1789135932.679759:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789135932.679764:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14491:x1876044666770816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.679831:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14491:x1876044666770816:12345-0@lo:502:llog_process_th.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.679838:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789135932.679915:0:14491:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.679929:0:14491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14491:1876044666770816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135932.679951:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135932.679959:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.679962:0:14491:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789135932.679968:0:14491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7e761a000 00000020:00000080:3.0:1789135932.679970:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135932.680016:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135932.680019:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.680021:0:14491:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789135932.680023:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135932.680025:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.680027:0:14491:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789135932.680030:0:14491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7e761a000 00000020:00000080:3.0:1789135932.680032:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135932.680060:0:14491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14491:1876044666770944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.680091:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.680107:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666770944 00000100:00100000:3.0:1789135932.680111:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666770944 00000100:00100000:3.0:1789135932.680129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789135932.680139:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14491:x1876044666770944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.680199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de643850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:14491:x1876044666770944:12345-0@lo:502:llog_process_th.0 Request processed in 59us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.680205:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789135932.680235:0:14491:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.680247:0:14491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14491:1876044666770944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135932.680264:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135932.680268:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.680270:0:14491:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789135932.680273:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789135932.680313:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789135932.680330:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135932.680337:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680345:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789135932.680355:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789135932.680357:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa5f7000 from 13 10000000:01000000:3.0:1789135932.680360:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789135932.680378:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680385:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680392:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.680415:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.680440:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.680453:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cadb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135932.680464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771072 00000100:00100000:3.0:1789135932.680467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771072 00000100:00100000:3.0:1789135932.680484:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789135932.680489:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:6513:x1876044666771072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135932.680496:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135932.680505:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2d26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2d1f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680521:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2d26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2d1f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680531:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2d26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2d1f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680539:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f200, rc 0) 00000100:00100000:3.0:1789135932.680566:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666771072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135932.680572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789135932.680599:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135932.680608:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.680616:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.680662:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.680688:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.680700:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cadb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789135932.681889:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771200 00000100:00100000:0.0:1789135932.681899:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771200 00000100:00100000:0.0:1789135932.681946:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789135932.681953:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666771200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.682068:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666771200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.682075:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789135932.694929:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.694993:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.695071:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.695112:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cadb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135932.695376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771328 00000100:00100000:1.0:1789135932.695383:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771328 00000100:00100000:1.0:1789135932.695451:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789135932.695461:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666771328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789135932.695593:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de640050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666771328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.695602:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789135932.695876:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135932.699870:0:14493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14493:1876044666771456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135932.699958:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135932.700033:0:14493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135932.700064:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771456 00000100:00100000:0.0:1789135932.700076:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771456 00000100:00100000:0.0:1789135932.701612:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1789135932.701628:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14493:x1876044666771456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135932.701791:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7de642850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14493:x1876044666771456:12345-0@lo:502:llog_process_th.0 Request processed in 168us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.701799:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789135932.707292:0:14493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14493:1876044666771456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789135932.707367:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789135932.707379:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789135932.707381:0:14493:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789135932.707925:0:14493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa5f7000 00000020:00000080:2.0:1789135932.707929:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789135932.708181:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135932.708186:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.708187:0:14493:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789135932.708190:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789135932.708193:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.708194:0:14493:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789135932.708197:0:14493:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa5f7000 00000020:00000080:3.0:1789135932.708199:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789135932.708256:0:14493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14493:1876044666771584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789135932.708364:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.708478:0:14493:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135932.710150:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771584 00000100:00100000:0.0:1789135932.710162:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771584 00000100:00100000:0.0:1789135932.710216:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789135932.710227:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14493:x1876044666771584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135932.710558:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:14493:x1876044666771584:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135932.710567:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1789135932.710981:0:14493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14493:1876044666771584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789135932.711021:0:14493:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789135932.711030:0:14493:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789135932.711032:0:14493:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789135932.711037:0:14493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789135932.711213:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:0.0:1789135932.711235:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789135932.711246:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.711257:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789135932.711268:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789135932.711271:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d26b4800 from 13 10000000:01000000:0.0:1789135932.711274:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789135932.711307:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.711314:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135932.711336:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135932.711357:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.714120:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135932.714179:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f660e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135932.714651:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771712 00000100:00100000:2.0:1789135932.714661:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771712 00000100:00100000:2.0:1789135932.714737:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789135932.714747:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+23:6513:x1876044666771712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135932.714764:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135932.714785:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de2d34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de2d2d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.714814:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de2d34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de2d2d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.714826:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de2d34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de2d2d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135932.714836:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5c00, rc 0) 00000100:00100000:2.0:1789135932.716122:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666771712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1369us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.716133:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789135932.716377:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135932.716728:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.716744:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135932.716838:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135932.716908:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135932.716946:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135932.718051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771840 00000100:00100000:2.0:1789135932.718060:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771840 00000100:00100000:2.0:1789135932.718114:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789135932.718123:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666771840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789135932.718268:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666771840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.718283:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789135932.718571:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.718620:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.718666:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135932.718714:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f660e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135932.719060:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666771968 00000100:00100000:2.0:1789135932.719066:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666771968 00000100:00100000:2.0:1789135932.719110:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789135932.719118:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666771968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789135932.719214:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:6513:x1876044666771968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.719222:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789135932.720619:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:44af6ea5-156e-4935-ba38-1972bb1ada25:6513:1876044666771968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789135932.723342:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14495:1876044666772096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789135932.723580:0:14495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135932.723672:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f660e3c0 going to sleep for 11 seconds 00000040:00080000:1.0:1789135932.727239:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789135932.729322:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772096 00000100:00100000:3.0:1789135932.729336:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772096 00000100:00100000:2.0:1789135932.747131:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1789135932.747146:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14495:x1876044666772096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135932.747332:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14495:x1876044666772096:12345-0@lo:502:llog_process_th.0 Request processed in 189us (23752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.747340:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789135932.747591:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14495:1876044666772096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135932.747632:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135932.747643:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135932.747645:0:14495:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789135932.747652:0:14495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d26b4800 00000020:00000080:1.0:1789135932.747655:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789135932.747728:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135932.747732:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135932.747734:0:14495:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789135932.747736:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789135932.747738:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135932.747739:0:14495:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789135932.747741:0:14495:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d26b4800 00000020:00000080:1.0:1789135932.747743:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789135932.747792:0:14495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14495:1876044666772224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789135932.747841:0:14495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135932.747905:0:14495:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f660e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135932.749062:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772224 00000100:00100000:2.0:1789135932.749073:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772224 00000100:00100000:2.0:1789135932.749125:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789135932.749134:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14495:x1876044666772224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789135932.749271:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:14495:x1876044666772224:12345-0@lo:502:llog_process_th.0 Request processed in 137us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135932.749279:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789135932.749690:0:14495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:44af6ea5-156e-4935-ba38-1972bb1ada25:14495:1876044666772224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789135932.749736:0:14495:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789135932.749744:0:14495:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789135932.749747:0:14495:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789135932.749751:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789135932.749965:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789135932.749986:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789135932.749997:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135932.750008:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135932.768698:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789135932.777788:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666772352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135932.777933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135932.778004:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772352 00000100:00100000:1.0:1789135932.778011:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772352 00000100:00100000:1.0:1789135932.778062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789135932.778070:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666772352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135932.778109:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135932.778158:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666772352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135932.778165:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789135932.778212:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666772352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135933.105610:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.106099:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648576 00000100:00100000:3.0:1789135933.106110:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648576 00000100:00100000:3.0:1789135933.106220:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 434 00000100:00100000:3.0:1789135933.106231:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+11:6167:x1876044644648576:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789135933.106250:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135933.106268:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de2d3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08922 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135933.106298:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de2d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08922 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135933.106324:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de2d3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08922 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135933.106334:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f600, rc 0) 00000100:00100000:3.0:1789135933.106412:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644648576:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 172us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.106419:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 434 00000100:00100000:0.0:1789135933.111329:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.111422:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648704 00000100:00100000:3.0:1789135933.111433:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648704 00000100:00100000:3.0:1789135933.111497:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 435 00000100:00100000:3.0:1789135933.111508:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644648704:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135933.111656:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644648704:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 149us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.111665:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 435 00000100:00100000:0.0:1789135933.126897:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.127718:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648832 00000100:00100000:3.0:1789135933.127731:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648832 00000100:00100000:3.0:1789135933.127804:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 436 00000100:00100000:3.0:1789135933.127816:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644648832:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135933.128191:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644648832:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 375us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.128200:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 436 00000100:00100000:0.0:1789135933.142490:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.142743:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644648960 00000100:00100000:3.0:1789135933.142752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644648960 00000100:00100000:3.0:1789135933.142812:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 437 00000100:00100000:3.0:1789135933.142822:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:11054:x1876044644648960:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135933.143016:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+12:11054:x1876044644648960:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 195us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.143025:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 437 00000100:00100000:0.0:1789135933.148347:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.148429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649088 00000100:00100000:3.0:1789135933.148439:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649088 00000100:00100000:3.0:1789135933.148508:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 438 00000100:00100000:3.0:1789135933.148520:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:11054:x1876044644649088:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135933.148667:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+12:11054:x1876044644649088:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 149us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.148676:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 438 00000100:00100000:0.0:1789135933.152532:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135933.152950:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649216 00000100:00100000:2.0:1789135933.152961:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649216 00000100:00100000:2.0:1789135933.153017:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 439 00000100:00100000:2.0:1789135933.153029:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+12:6167:x1876044644649216:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789135933.153048:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135933.153085:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f4c00/0x559c8745c6de2d42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08929 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135933.153115:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f4c00/0x559c8745c6de2d42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08929 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135933.153127:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f4c00/0x559c8745c6de2d42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08929 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135933.153136:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4c00, rc 0) 00000100:00100000:2.0:1789135933.153204:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644649216:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 177us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.153211:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 439 00000100:00100000:0.0:1789135933.162741:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.162831:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649344 00000100:00100000:3.0:1789135933.162841:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649344 00000100:00100000:3.0:1789135933.162930:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 440 00000100:00100000:3.0:1789135933.162950:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644649344:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789135933.163105:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644649344:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 156us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.163113:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 440 00000100:00100000:0.0:1789135933.166970:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.167098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649472 00000100:00100000:3.0:1789135933.167109:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649472 00000100:00100000:3.0:1789135933.167222:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 441 00000100:00100000:3.0:1789135933.167234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644649472:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789135933.167384:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:6167:x1876044644649472:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 152us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.167392:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 441 00000100:00100000:0.0:1789135933.182200:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135933.182502:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649600 00000100:00100000:2.0:1789135933.182514:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649600 00000100:00100000:2.0:1789135933.182583:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 442 00000100:00100000:2.0:1789135933.182594:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:11057:x1876044644649600:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789135933.182762:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:11057:x1876044644649600:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 169us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.182770:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 442 00000100:00100000:0.0:1789135933.207328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135933.207433:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649728 00000100:00100000:3.0:1789135933.207443:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649728 00000100:00100000:3.0:1789135933.207508:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 443 00000100:00100000:3.0:1789135933.207519:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:11057:x1876044644649728:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789135933.207660:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:11057:x1876044644649728:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.207669:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 443 00000100:00100000:3.0:1789135933.289365:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666772480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135933.289458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135933.290050:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135933.290064:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666772608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135933.290100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290307:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666772864:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.290342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290361:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666773376:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.290378:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290395:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666773888:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.290443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290462:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789135933.290640:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666772992:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.290674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290713:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666773504:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.290737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290759:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666774016:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.290782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135933.290814:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772864 00000100:00100000:1.0:1789135933.290823:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772864 00000100:00100000:1.0:1789135933.290908:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773376 00000100:00100000:1.0:1789135933.290912:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773376 00000100:00100000:1.0:1789135933.290932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773504 00000100:00100000:1.0:1789135933.290934:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773504 00000100:00100000:1.0:1789135933.290950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789135933.290958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666772864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.291018:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666772864:12345-0@lo:400:kworker.0 Request processed in 60us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135933.291025:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789135933.291044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789135933.291050:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666773376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.291078:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666773376:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135933.291084:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789135933.291095:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789135933.291101:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666773504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.291125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666773504:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135933.291131:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789135933.291149:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772992 00000100:00100000:1.0:1789135933.291153:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772992 00000100:00100000:1.0:1789135933.291189:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789135933.291195:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666772992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.291225:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666772992:12345-0@lo:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135933.291230:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789135933.291280:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666772992:0@lo:400:kworker.0 00010000:00080000:1.0:1789135933.291293:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5d5a40 x1876044666773504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135933.291303:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666773504:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.291313:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666772864:0@lo:400:kworker.0 00000100:00100000:1.0:1789135933.291321:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666773376:0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.291777:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772480 00000100:00100000:2.0:1789135933.291783:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772480 00000100:00100000:2.0:1789135933.291825:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772608 00000100:00100000:2.0:1789135933.291829:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772608 00000100:00100000:2.0:1789135933.291848:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789135933.291875:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666772480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135933.291899:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135933.291954:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666772480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.291969:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789135933.291984:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789135933.291990:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666772608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135933.292000:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135933.292027:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666772608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.292032:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789135933.292055:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773888 00000100:00100000:2.0:1789135933.292058:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773888 00000100:00100000:2.0:1789135933.292085:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774016 00000100:00100000:2.0:1789135933.292088:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774016 00000100:00100000:2.0:1789135933.292105:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789135933.292111:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666773888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.292147:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666773888:12345-0@lo:400:kworker.0 Request processed in 35us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.292153:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789135933.292166:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789135933.292172:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666774016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.292197:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666774016:12345-0@lo:400:kworker.0 Request processed in 25us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.292202:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789135933.292238:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666774016:0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.292251:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666773888:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.292828:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666772736:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.292897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135933.292954:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666773248:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.292979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135933.292997:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666773760:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.293019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789135933.293045:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c446ed00 x1876044666772608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135933.293062:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666772608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135933.293077:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789135933.293083:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666773120:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.293102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135933.293115:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666773632:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.293133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135933.293228:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773760 00000100:00100000:3.0:1789135933.293233:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773760 00000100:00100000:3.0:1789135933.293266:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773120 00000100:00100000:3.0:1789135933.293269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773120 00000100:00100000:3.0:1789135933.293279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773632 00000100:00100000:3.0:1789135933.293282:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773632 00000100:00100000:3.0:1789135933.293297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789135933.293304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666773760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135933.293351:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666773760:12345-0@lo:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.293357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789135933.293369:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789135933.293375:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666773120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135933.293398:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666773120:12345-0@lo:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.293419:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789135933.293438:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789135933.293444:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666773632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135933.293494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666773632:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135933.293501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1789135933.293518:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135933.293522:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135933.293525:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135933.293527:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789135933.293950:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4499e00 x1876044666772480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135933.293969:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666772480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135933.294129:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666773120:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.294140:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666773632:0@lo:400:kworker.0 00010000:00080000:0.0:1789135933.294151:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5d7c00 x1876044666773760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135933.294159:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666773760:0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.294241:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666773248 00000100:00100000:2.0:1789135933.294246:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666773248 00000100:00100000:2.0:1789135933.294294:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135933.294300:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666773248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.294352:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666773248:12345-0@lo:400:kworker.0 Request processed in 52us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.294358:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135933.294382:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666772736 00000100:00100000:2.0:1789135933.294386:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666772736 00000100:00100000:2.0:1789135933.294433:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1789135933.294440:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666772736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.294738:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666772736:0@lo:400:kworker.0 00000100:00100000:0.0:1789135933.294760:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666773248:0@lo:400:kworker.0 00000100:00100000:2.0:1789135933.294817:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666772736:12345-0@lo:400:kworker.0 Request processed in 375us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.294824:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00010000:00010000:0.0:1789135933.672073:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135933.738263:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789135933.800636:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789135933.803183:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666774272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135933.803264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135933.803353:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135933.803361:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666774144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135933.803384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135933.803474:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774272 00000100:00100000:2.0:1789135933.803483:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774272 00000100:00100000:2.0:1789135933.803535:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774144 00000100:00100000:2.0:1789135933.803538:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774144 00000100:00100000:2.0:1789135933.803552:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789135933.803559:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666774272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135933.803587:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135933.803635:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666774272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135933.803641:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789135933.803657:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789135933.803662:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666774144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135933.803682:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135933.803722:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666774144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135933.804048:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666774144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135933.804065:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4498f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666774272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135933.804194:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789135934.312337:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666774400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135934.312417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135934.312634:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774400 00000100:00100000:1.0:1789135934.312646:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774400 00000100:00100000:1.0:1789135934.312723:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789135934.312744:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666774400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135934.312781:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135934.323617:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666774400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10865us (11189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.323633:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789135934.324164:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666774400:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135934.696129:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135934.970220:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135934.970297:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135934.970332:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135934.970370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135934.970404:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135934.970443:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135934.970485:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650112 00000100:00100000:1.0:1789135934.970494:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650112 00000100:00100000:1.0:1789135934.970559:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650368 00000100:00100000:1.0:1789135934.970563:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650368 00000100:00100000:1.0:1789135934.970578:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649984 00000100:00100000:1.0:1789135934.970581:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649984 00000100:00100000:1.0:1789135934.970594:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650496 00000100:00100000:1.0:1789135934.970596:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650496 00000100:00100000:1.0:1789135934.970609:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 301 00000100:00100000:1.0:1789135934.970617:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644650112:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135934.970707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 302 00000100:00100000:1.0:1789135934.970710:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644650112:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 91us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.970724:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 301 00000100:00100000:2.0:1789135934.970725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644650368:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135934.970753:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 303 00000100:00100000:2.0:1789135934.970765:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644650368:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 45us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.970766:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644649984:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135934.970780:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 302 00000100:00100000:2.0:1789135934.970800:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 304 00000100:00100000:1.0:1789135934.970808:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644649984:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 46us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135934.970811:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644650496:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135934.970822:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 303 00000100:00100000:2.0:1789135934.970843:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644650496:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 35us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135934.970851:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 304 00000100:00100000:1.0:1789135934.970899:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650240 00000100:00100000:1.0:1789135934.970904:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650240 00000100:00100000:1.0:1789135934.971781:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:1.0:1789135934.971792:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644650240:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135934.971872:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644650240:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 64us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135934.971880:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00080000:3.0:1789135934.976249:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135934.976261:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135934.976265:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135934.976284:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644649856 00000100:00100000:3.0:1789135934.976294:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644649856 00000100:00100000:3.0:1789135934.976362:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 445 00000100:00100000:3.0:1789135934.976372:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644649856:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135934.977560:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644649856:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 1185us (7347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135934.977572:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 445 00010000:00010000:0.0:1789135935.720013:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135936.745488:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789135936.880568:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1789135937.768175:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135937.896288:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135937.896326:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666774528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135937.896418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135937.896843:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774528 00000100:00100000:2.0:1789135937.896852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774528 00000100:00100000:2.0:1789135937.897009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789135937.897021:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666774528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789135937.897068:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789135937.897128:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666774528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135937.897134:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789135937.897274:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666774528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135938.408280:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666774784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135938.408381:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135938.408498:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666774656:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.408530:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135938.408544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135938.408631:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4498780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666774912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135938.408652:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774784 00000100:00100000:1.0:1789135938.408660:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774784 00000100:00100000:2.0:1789135938.408687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135938.408728:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774912 00000100:00100000:1.0:1789135938.408732:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774912 00000100:00100000:1.0:1789135938.408761:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789135938.408770:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666774784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135938.408805:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135938.408889:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789135938.408899:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666774912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135938.408928:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135938.408966:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666774912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.408973:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:2.0:1789135938.409478:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4498780 x1876044666774912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135938.409498:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4498780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666774912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135938.409524:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6681e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666775040:0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.409635:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666774656 00000100:00100000:3.0:1789135938.409641:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666774656 00000100:00100000:3.0:1789135938.409674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789135938.409681:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666774656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.409908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135938.409937:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666775552:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.409965:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135938.409987:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6685680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666776064:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.410026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135938.410093:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666774784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1323us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135938.410103:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1789135938.410130:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135938.410143:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666775424:0@lo:400:kworker.0 00000100:00100000:1.0:1789135938.410174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135938.410196:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6684b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666775936:0@lo:400:kworker.0 00000100:00100000:1.0:1789135938.410220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135938.410284:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775040 00000100:00100000:1.0:1789135938.410288:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775040 00000100:00100000:1.0:1789135938.410320:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775552 00000100:00100000:1.0:1789135938.410323:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775552 00000100:00100000:1.0:1789135938.410344:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775424 00000100:00100000:1.0:1789135938.410347:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775424 00000100:00100000:1.0:1789135938.410362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789135938.410369:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666775040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135938.410406:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666775040:12345-0@lo:400:kworker.0 Request processed in 38us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135938.410412:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789135938.410425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789135938.410520:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666774656:12345-0@lo:400:kworker.0 Request processed in 838us (1975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135938.410527:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789135938.410576:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6682d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666775168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.410611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135938.410637:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666775680:0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.410660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135938.410684:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6680f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666774656:0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.410702:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789135938.410707:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666775296:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.414762:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6681e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666775040:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.414834:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776064 00000100:00100000:2.0:1789135938.414843:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776064 00000100:00100000:2.0:1789135938.414932:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775936 00000100:00100000:2.0:1789135938.414936:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775936 00000100:00100000:2.0:1789135938.414963:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789135938.414970:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666776064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415055:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666776064:12345-0@lo:400:kworker.0 Request processed in 85us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415076:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789135938.415093:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789135938.415099:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666775936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415135:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666775936:12345-0@lo:400:kworker.0 Request processed in 37us (4914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415141:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789135938.415176:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6684b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666775936:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415199:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1789135938.415205:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a6c44b7480, transno 4294967301 00000100:00100000:2.0:1789135938.415216:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6685680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666776064:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415358:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775168 00000100:00100000:2.0:1789135938.415363:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775168 00000100:00100000:2.0:1789135938.415384:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775680 00000100:00100000:2.0:1789135938.415387:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775680 00000100:00100000:2.0:1789135938.415404:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789135938.415411:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666775424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415452:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666775424:12345-0@lo:400:kworker.0 Request processed in 41us (5277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415458:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789135938.415473:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789135938.415479:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6686d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666775168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415507:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6686d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666775168:12345-0@lo:400:kworker.0 Request processed in 28us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415514:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789135938.415526:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789135938.415541:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6685e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666775680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.415573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135938.415582:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6685e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666775680:12345-0@lo:400:kworker.0 Request processed in 41us (4919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415589:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789135938.415626:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666775808:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415644:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666775424:0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.415658:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135938.415684:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775296 00000100:00100000:2.0:1789135938.415689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775296 00000100:00100000:3.0:1789135938.415692:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6682d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666775168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135938.415710:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666775680:0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415724:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789135938.415732:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6686940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666775296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415764:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6686940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666775296:12345-0@lo:400:kworker.0 Request processed in 34us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415770:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789135938.415791:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666775808 00000100:00100000:2.0:1789135938.415794:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666775808 00000100:00100000:1.0:1789135938.415816:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666775552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135938.415822:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789135938.415830:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6684f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666775808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135938.415884:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666775552:12345-0@lo:400:kworker.0 Request processed in 5454us (5918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135938.415893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789135938.415910:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6684f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666775808:12345-0@lo:400:kworker.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.415917:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:2.0:1789135938.415956:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135938.415961:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135938.415963:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789135938.415984:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e83480 x1876044666775552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135938.415997:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666775552:0@lo:400:kworker.0 00010000:00080000:0.0:1789135938.416106:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4499a40 x1876044666774784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135938.416125:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4499a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666774784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135938.416194:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666775296:0@lo:400:kworker.0 00010000:00080000:3.0:1789135938.416204:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6684000 x1876044666775808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135938.416212:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666775808:0@lo:400:kworker.0 00010000:00010000:0.0:1789135938.795217:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135938.920215:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135938.920280:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666776192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135938.920296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135938.920326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135938.920503:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776320 00000100:00100000:2.0:1789135938.920524:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776320 00000100:00100000:2.0:1789135938.920581:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776192 00000100:00100000:2.0:1789135938.920585:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776192 00000100:00100000:2.0:1789135938.920613:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789135938.920623:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666776320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135938.920654:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135938.920739:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789135938.920748:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666776192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135938.920760:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135938.931225:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666776320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10573us (10898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135938.931242:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789135938.931404:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135938.931655:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666776192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135938.932113:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666776192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11363us (11783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135938.932141:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789135939.434512:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666776448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135939.434623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135939.434780:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776448 00000100:00100000:1.0:1789135939.434789:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776448 00000100:00100000:1.0:1789135939.434847:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789135939.434878:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666776448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135939.434914:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135939.435020:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666776448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135939.435026:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789135939.435232:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666776448:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135939.816150:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135940.082028:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135940.082077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135940.082166:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650752 00000100:00100000:2.0:1789135940.082177:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650752 00000100:00100000:2.0:1789135940.082262:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 311 00000100:00100000:2.0:1789135940.082274:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644650752:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135940.082354:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644650752:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 83us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135940.082362:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 311 00000100:00100000:0.0:1789135940.082537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135940.082569:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135940.082605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135940.082639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135940.082658:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650624 00000100:00100000:0.0:1789135940.082662:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650624 00000100:00100000:0.0:1789135940.082693:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 447 00000100:00100000:0.0:1789135940.082700:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644650624:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135940.082735:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d832c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644650624:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135940.082743:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 447 00000100:00080000:1.0:1789135940.083017:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135940.083031:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651264 00000100:00100000:1.0:1789135940.083035:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651264 00000100:00100000:1.0:1789135940.083078:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644650880 00000100:00100000:1.0:1789135940.083082:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644650880 00000100:00100000:1.0:1789135940.083097:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651136 00000100:00100000:1.0:1789135940.083099:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651136 00000100:00100000:1.0:1789135940.083115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 312 00000100:00100000:1.0:1789135940.083122:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644651264:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135940.083216:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644651264:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 94us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135940.083223:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 312 00000100:00100000:1.0:1789135940.083238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 313 00000100:00100000:1.0:1789135940.083244:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644650880:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135940.083267:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644650880:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135940.083273:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 313 00000100:00100000:1.0:1789135940.083283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 314 00000100:00100000:1.0:1789135940.083289:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644651136:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135940.083308:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644651136:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135940.083313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 314 00000100:00080000:0.0:1789135940.083489:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135940.083492:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135940.089255:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651008 00000100:00100000:3.0:1789135940.089272:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651008 00000100:00100000:3.0:1789135940.090064:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:3.0:1789135940.090076:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644651008:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135940.090173:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644651008:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 98us (8094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135940.090182:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00080000:0.0:1789135940.097373:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789135940.840090:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135941.864044:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135942.887972:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135943.018755:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666776576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135943.018822:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135943.018969:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776576 00000100:00100000:1.0:1789135943.018975:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776576 00000100:00100000:1.0:1789135943.019022:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135943.019029:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666776576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789135943.019060:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789135943.019099:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666776576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135943.019105:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135943.019144:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666776576:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789135943.021344:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789135943.528148:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789135943.528171:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c449b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666776704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135943.528240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.528652:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776704 00000100:00100000:2.0:1789135943.528659:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776704 00000100:00100000:2.0:1789135943.528725:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789135943.528736:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666776704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135943.528766:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135943.528810:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666776704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135943.528818:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1789135943.528891:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135943.528939:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666776832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135943.528972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789135943.529013:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c449b840 x1876044666776704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135943.529031:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c449b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666776704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135943.529110:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776832 00000100:00100000:1.0:1789135943.529114:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776832 00000100:00100000:1.0:1789135943.529155:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789135943.529162:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666776832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135943.529173:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135943.529205:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666776832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135943.529211:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00010000:00080000:1.0:1789135943.529238:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b5a40 x1876044666776832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135943.529250:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666776832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789135943.529303:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135943.531214:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666777088:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.531342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666777600:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.531383:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666778112:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531407:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.531521:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789135943.531528:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666776960:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.531585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666777472:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.531619:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666777984:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135943.531668:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778112 00000100:00100000:2.0:1789135943.531674:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778112 00000100:00100000:2.0:1789135943.531722:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777984 00000100:00100000:2.0:1789135943.531726:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777984 00000100:00100000:2.0:1789135943.531746:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135943.531754:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666778112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.531799:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666778112:12345-0@lo:400:kworker.0 Request processed in 46us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135943.531806:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789135943.531821:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135943.531827:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.531954:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666776960 00000100:00100000:3.0:1789135943.531959:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666776960 00000100:00100000:3.0:1789135943.531997:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1789135943.532005:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666776960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135943.532013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777088 00000100:00100000:1.0:1789135943.532019:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777088 00000100:00100000:3.0:1789135943.532047:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666776960:12345-0@lo:400:kworker.0 Request processed in 43us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135943.532054:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777600 00000100:00100000:3.0:1789135943.532057:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1789135943.532058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777600 00000100:00100000:1.0:1789135943.532090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777472 00000100:00100000:1.0:1789135943.532093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777472 00000100:00100000:3.0:1789135943.532103:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666777216:0@lo:400:kworker.0 00000100:00100000:1.0:1789135943.532109:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789135943.532118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666777088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.532136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135943.532257:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777216 00000100:00100000:0.0:1789135943.532262:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777216 00000100:00100000:0.0:1789135943.532283:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789135943.532290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.535167:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666777728:0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.535239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135943.535267:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789135943.535274:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666777344:0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.535300:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135943.535331:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666777856:0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.535355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135943.535393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777344 00000100:00100000:3.0:1789135943.535400:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777344 00000100:00100000:3.0:1789135943.535450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789135943.535459:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6685a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666777344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.535525:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6685a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666777344:12345-0@lo:400:kworker.0 Request processed in 67us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135943.535550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789135943.535597:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666777344:0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.535648:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789135943.535657:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1789135943.535752:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135943.535759:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135943.536670:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135943.536711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777728 00000100:00100000:3.0:1789135943.536717:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777728 00000100:00100000:1.0:1789135943.536812:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666777088:12345-0@lo:400:kworker.0 Request processed in 4693us (5524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135943.536821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789135943.536842:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666777856 00000100:00100000:1.0:1789135943.536846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666777856 00000100:00100000:3.0:1789135943.536850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789135943.536877:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4499a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666777472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135943.536885:0:6516:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789135943.536895:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789135943.536904:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666777216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.537251:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666777984:12345-0@lo:400:kworker.0 Request processed in 5422us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135943.537278:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789135943.537333:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666776960:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.537348:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666777984:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.537357:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666777088:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.537369:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666778112:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.538566:0:14528:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1789135943.538577:0:14528:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00080000:2.0:1789135943.538612:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135943.538617:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135943.538713:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789135943.538723:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666777728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135943.543209:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666777600:12345-0@lo:400:kworker.0 Request processed in 10909us (11834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135943.543229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789135943.543270:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1789135943.543284:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789135943.543297:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6684780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666777856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135943.543354:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6684780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666777856:12345-0@lo:400:kworker.0 Request processed in 63us (7998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135943.543361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00080000:0.0:1789135943.543408:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff6492c0 x1876044666777600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135943.544104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666777216:12345-0@lo:400:kworker.0 Request processed in 7199us (11965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135943.544113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:1.0:1789135943.544185:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff648b40 x1876044666777856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135943.544198:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666777856:0@lo:400:kworker.0 00000100:00100000:1.0:1789135943.544212:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666777216:0@lo:400:kworker.0 00000100:00100000:0.0:1789135943.546374:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666777600:0@lo:400:kworker.0 00000100:00100000:3.0:1789135943.546756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4499a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666777472:12345-0@lo:400:kworker.0 Request processed in 9879us (15146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135943.546832:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789135943.551404:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666777472:0@lo:400:kworker.0 00000100:00100000:2.0:1789135943.554588:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666777728:12345-0@lo:400:kworker.0 Request processed in 15856us (19338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135943.554603:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789135943.555281:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666777728:0@lo:400:kworker.0 00010000:00010000:0.0:1789135943.912538:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135943.976579:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789135944.040470:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666778240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135944.040545:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666778368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135944.040567:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135944.041045:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778240 00000100:00100000:2.0:1789135944.041053:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778240 00000100:00100000:2.0:1789135944.041112:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789135944.041121:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6687c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666778240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135944.041153:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135944.043832:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6687c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666778240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2700us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135944.043848:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789135944.048434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135944.048657:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778368 00000100:00100000:2.0:1789135944.048667:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778368 00000100:00100000:2.0:1789135944.048723:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789135944.048749:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666778368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135944.048787:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135944.048881:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666778368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135944.048888:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789135944.049445:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666778240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135944.049610:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666778368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135944.552641:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666778496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135944.552739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135944.553093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778496 00000100:00100000:2.0:1789135944.553102:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778496 00000100:00100000:2.0:1789135944.553157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789135944.553166:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666778496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135944.553199:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135944.553256:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666778496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135944.553263:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789135944.553519:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666778496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135944.937031:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135945.202006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135945.202059:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135945.202086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135945.202195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651392 00000100:00100000:1.0:1789135945.202205:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651392 00000100:00100000:1.0:1789135945.202261:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 449 00000100:00100000:1.0:1789135945.202271:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644651392:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135945.202345:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644651392:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 76us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135945.202353:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 449 00000100:00100000:2.0:1789135945.202567:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651520 00000100:00100000:2.0:1789135945.202574:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651520 00000100:00100000:2.0:1789135945.202665:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651648 00000100:00100000:2.0:1789135945.202669:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651648 00000100:00080000:1.0:1789135945.202698:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135945.202702:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135945.202716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 321 00000100:00100000:1.0:1789135945.202724:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644651520:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135945.202772:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644651520:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 50us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135945.202779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 321 00000100:00100000:2.0:1789135945.202917:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 322 00000100:00100000:2.0:1789135945.202924:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644651648:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135945.202960:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644651648:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 36us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135945.203096:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 322 00000100:00100000:1.0:1789135945.230289:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135945.230387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652032 00000100:00100000:3.0:1789135945.230397:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652032 00000100:00100000:3.0:1789135945.230491:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 323 00000100:00100000:3.0:1789135945.230502:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644652032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135945.230587:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644652032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 87us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135945.230596:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 323 00000100:00080000:1.0:1789135945.230663:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135945.245008:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135945.245237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651904 00000100:00100000:1.0:1789135945.245249:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651904 00000100:00100000:1.0:1789135945.245333:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 324 00000100:00100000:1.0:1789135945.245344:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644651904:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135945.245458:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644651904:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 116us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135945.245466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 324 00000100:00080000:2.0:1789135945.245699:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135945.245846:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135945.245952:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644651776 00000100:00100000:1.0:1789135945.245957:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644651776 00000100:00100000:1.0:1789135945.246009:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1789135945.246017:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2388:x1876044644651776:12345-192.168.201.31@tcp:9:kworker.0 00000100:00080000:2.0:1789135945.246111:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1789135945.246255:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2c69 00000100:00080000:1.0:1789135945.246266:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a7ff5b6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789135945.246372:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1789135945.246537:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+2:2388:x1876044644651776:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 520us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135945.246544:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00010000:00010000:0.0:1789135945.250594:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135945.960923:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135946.984240:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135948.008168:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135948.136391:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135948.136416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666778624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135948.136503:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135948.136779:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778624 00000100:00100000:3.0:1789135948.136789:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778624 00000100:00100000:3.0:1789135948.136875:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789135948.136885:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666778624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135948.136922:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789135948.136990:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666778624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135948.136996:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789135948.137224:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666778624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135948.648242:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135948.648274:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666778752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135948.648350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135948.648730:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666778880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135948.648760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135948.648848:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778752 00000100:00100000:1.0:1789135948.648872:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778752 00000100:00100000:1.0:1789135948.648931:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666778880 00000100:00100000:1.0:1789135948.648943:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666778880 00000100:00100000:1.0:1789135948.648966:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789135948.648976:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666778752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789135948.649009:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135948.649062:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666778752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135948.649069:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789135948.649110:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135948.649116:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666778880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135948.649126:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135948.649151:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666778880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135948.649157:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1789135948.649270:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789135948.649308:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b52c0 x1876044666778880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135948.649329:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666778880:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789135948.649342:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b6940 x1876044666778752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135948.649352:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666778752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135948.650066:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666779392:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.650117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135948.650140:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666779904:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.650179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135948.650214:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789135948.650221:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666779264:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.650244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135948.650268:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666779776:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.650290:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135948.650320:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779904 00000100:00100000:2.0:1789135948.650326:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779904 00000100:00100000:3.0:1789135948.650366:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779392 00000100:00100000:2.0:1789135948.650369:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779264 00000100:00100000:3.0:1789135948.650371:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779392 00000100:00100000:2.0:1789135948.650371:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779264 00000100:00100000:2.0:1789135948.650388:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779776 00000100:00100000:2.0:1789135948.650390:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779776 00000100:00100000:3.0:1789135948.650399:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789135948.650406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666779392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.650406:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789135948.650410:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666779904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.650464:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666779392:12345-0@lo:400:kworker.0 Request processed in 58us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135948.650471:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789135948.650493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666779136:0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.650507:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666779008:0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.650518:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135948.650530:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f64130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666779648:0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.650537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135948.650550:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135948.650559:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666780160:0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.650559:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666779520:0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.650580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135948.650580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135948.650589:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666780032:0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.650607:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779008 00000100:00100000:0.0:1789135948.650608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135948.650610:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779008 00000100:00100000:3.0:1789135948.650635:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1789135948.650637:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780160 00000100:00100000:0.0:1789135948.650640:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780160 00000100:00100000:3.0:1789135948.650641:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666779008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.650667:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780032 00000100:00100000:0.0:1789135948.650671:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780032 00000100:00100000:3.0:1789135948.650673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c5e70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666779008:12345-0@lo:400:kworker.0 Request processed in 34us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135948.650687:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1789135948.650689:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789135948.650695:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666780160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.650716:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789135948.650723:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666780032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.650735:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666780160:12345-0@lo:400:kworker.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135948.650741:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789135948.650747:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666780032:12345-0@lo:400:kworker.0 Request processed in 26us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135948.650753:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789135948.650840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779136 00000100:00100000:1.0:1789135948.650845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779136 00000100:00100000:1.0:1789135948.650881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779648 00000100:00100000:1.0:1789135948.650885:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779648 00000100:00100000:1.0:1789135948.650900:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666779520 00000100:00100000:1.0:1789135948.650902:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666779520 00000100:00100000:1.0:1789135948.650915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789135948.650921:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666779264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.651405:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666779008:0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.651432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666780032:0@lo:400:kworker.0 00000100:00100000:0.0:1789135948.651466:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789135948.651476:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666779776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.651648:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666779904:12345-0@lo:400:kworker.0 Request processed in 1235us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135948.651655:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789135948.651675:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789135948.651682:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6687840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666779136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.651711:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6687840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666779136:12345-0@lo:400:kworker.0 Request processed in 30us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135948.651717:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789135948.651731:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789135948.651738:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6686580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666779648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.651765:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6686580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666779648:12345-0@lo:400:kworker.0 Request processed in 28us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135948.651783:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789135948.651795:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789135948.651801:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666779520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.651867:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666779520:12345-0@lo:400:kworker.0 Request processed in 51us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135948.651873:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00080000:2.0:1789135948.651896:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135948.651900:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135948.651902:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135948.651964:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666779776:12345-0@lo:400:kworker.0 Request processed in 491us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135948.651971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789135948.652001:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666779520:0@lo:400:kworker.0 00000100:00100000:1.0:1789135948.658967:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666779264:12345-0@lo:400:kworker.0 Request processed in 8033us (8710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135948.658984:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789135948.665026:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666779136:0@lo:400:kworker.0 00010000:00080000:3.0:1789135948.665068:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f64130c0 x1876044666779648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135948.665081:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f64130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666779648:0@lo:400:kworker.0 00000100:00100000:3.0:1789135948.665094:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666780160:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.665330:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666779264:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.665343:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666779776:0@lo:400:kworker.0 00000100:00100000:2.0:1789135948.665356:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666779392:0@lo:400:kworker.0 00010000:00080000:2.0:1789135948.665369:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662a580 x1876044666779904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135948.665379:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666779904:0@lo:400:kworker.0 00010000:00010000:1.0:1789135949.032463:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135949.160271:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666780288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135949.160355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135949.160573:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666780416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135949.160608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135949.160646:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780288 00000100:00100000:2.0:1789135949.160653:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780288 00000100:00100000:2.0:1789135949.160696:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780416 00000100:00100000:2.0:1789135949.160699:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780416 00000100:00100000:2.0:1789135949.160714:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789135949.160723:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666780288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135949.160755:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135949.160813:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666780288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135949.160820:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789135949.160851:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789135949.160888:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666780416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135949.160901:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135949.160943:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666780416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135949.160950:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789135949.160994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666780416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135949.161793:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666780288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135949.672969:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135949.672994:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666780544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135949.673074:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135949.673213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780544 00000100:00100000:2.0:1789135949.673221:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780544 00000100:00100000:2.0:1789135949.673277:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789135949.673286:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666780544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135949.673322:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135949.673380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666780544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135949.673388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789135949.673632:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666780544:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789135950.056613:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135950.321007:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135950.321059:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135950.321103:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135950.321129:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135950.321155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135950.321185:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652160 00000100:00100000:3.0:1789135950.321195:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652160 00000100:00100000:0.0:1789135950.321246:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652288 00000100:00100000:0.0:1789135950.321252:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652288 00000100:00100000:3.0:1789135950.321258:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 451 00000100:00100000:3.0:1789135950.321283:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644652160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135950.321293:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652544 00000100:00100000:0.0:1789135950.321297:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652544 00000100:00100000:0.0:1789135950.321314:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652416 00000100:00100000:0.0:1789135950.321316:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652416 00000100:00100000:0.0:1789135950.321329:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652672 00000100:00100000:0.0:1789135950.321331:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652672 00000100:00100000:0.0:1789135950.321345:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 331 00000100:00100000:0.0:1789135950.321353:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6687c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644652288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135950.321360:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c2ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644652160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135950.321370:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 451 00000100:00100000:3.0:1789135950.321436:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 332 00000100:00100000:3.0:1789135950.321445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6685680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644652544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135950.321475:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6685680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644652544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135950.321482:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 332 00000100:00100000:0.0:1789135950.321495:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6687c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644652288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 70us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135950.321500:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 333 00000100:00100000:0.0:1789135950.321511:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 331 00000100:00100000:3.0:1789135950.321513:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6684b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644652416:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135950.321534:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 334 00000100:00100000:3.0:1789135950.321543:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6684b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644652416:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 34us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135950.321550:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644652672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135950.321556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 333 00000100:00100000:0.0:1789135950.321586:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644652672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135950.321592:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 334 00000100:00080000:2.0:1789135950.321904:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135950.321910:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789135950.697902:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:1.0:1789135950.697911:0:9511:0:(genops.c:885:class_export_put()) final put ffff90a7ff5b4000/50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:3.0:1789135950.697971:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5b4000/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-OST0001 00000020:00000080:3.0:1789135950.698514:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff5b6000 for lustre-OST0001 00010000:00010000:2.0:1789135951.081264:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135952.106284:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135953.127982:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135953.192652:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789135953.256068:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666780672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135953.256144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135953.256321:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780672 00000100:00100000:0.0:1789135953.256329:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780672 00000100:00100000:0.0:1789135953.256396:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789135953.256407:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666780672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135953.256442:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135953.256500:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666780672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135953.256508:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789135953.256603:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666780672:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789135953.268947:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789135953.768552:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135953.768682:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666780800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135953.768755:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135953.768893:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780800 00000100:00100000:0.0:1789135953.768901:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780800 00000100:00100000:0.0:1789135953.768971:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789135953.768981:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666780800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135953.769016:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135953.769066:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666780800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135953.769095:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00080000:0.0:1789135953.769151:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f660a1c0 x1876044666780800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135953.769169:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666780800:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789135953.769502:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135953.769630:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666781184:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.769665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.769693:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666781696:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.769720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.769736:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666782208:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.769760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.769780:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789135953.769785:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666781056:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.769816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.769832:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666781568:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.769850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.769888:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6682d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666782080:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.769911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.770063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781184 00000100:00100000:3.0:1789135953.770068:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781184 00000100:00100000:3.0:1789135953.770224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781056 00000100:00100000:3.0:1789135953.770228:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781056 00000100:00100000:3.0:1789135953.770248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781568 00000100:00100000:3.0:1789135953.770250:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781568 00000100:00100000:3.0:1789135953.770273:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789135953.770281:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6681e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666781184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.770338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6681e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666781184:12345-0@lo:400:kworker.0 Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.770345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789135953.770361:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789135953.770368:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.770396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666781056:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.770402:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789135953.770413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789135953.770419:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666781568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.770446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666781568:12345-0@lo:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.770453:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789135953.770481:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781696 00000100:00100000:3.0:1789135953.770488:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781696 00000100:00100000:3.0:1789135953.770511:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782208 00000100:00100000:3.0:1789135953.770514:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782208 00000100:00100000:3.0:1789135953.770524:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782080 00000100:00100000:3.0:1789135953.770526:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782080 00000100:00100000:3.0:1789135953.770537:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135953.770543:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6680f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666781696:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789135953.770663:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135953.770667:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135953.770676:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135953.770692:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666780928:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.770727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.770756:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666781440:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.770777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.770794:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666781952:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.770814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.770832:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789135953.770838:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666781312:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.770880:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.770899:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666781824:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.770919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135953.771012:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666780928 00000100:00100000:2.0:1789135953.771016:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666780928 00000100:00100000:2.0:1789135953.771043:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789135953.771049:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666780928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.771096:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3639:x1876044666780928:12345-0@lo:400:kworker.0 Request processed in 47us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.771176:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789135953.771206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781312 00000100:00100000:2.0:1789135953.771209:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781312 00000100:00100000:2.0:1789135953.771232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789135953.771239:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666781312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.771272:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666781312:12345-0@lo:400:kworker.0 Request processed in 34us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.771276:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789135953.771303:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781440 00000100:00100000:2.0:1789135953.771306:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781440 00000100:00100000:2.0:1789135953.771338:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781952 00000100:00100000:2.0:1789135953.771341:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781952 00000100:00100000:2.0:1789135953.771354:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666781824 00000100:00100000:2.0:1789135953.771356:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666781824 00000100:00100000:2.0:1789135953.771368:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789135953.771374:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666781440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.771408:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666781440:12345-0@lo:400:kworker.0 Request processed in 35us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.771414:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789135953.771424:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789135953.771429:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666781952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.771456:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666781952:12345-0@lo:400:kworker.0 Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.771462:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789135953.771473:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789135953.771480:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666781824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.771504:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666781824:12345-0@lo:400:kworker.0 Request processed in 25us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135953.771509:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:2.0:1789135953.771521:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135953.771524:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135953.771547:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666781312:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.771557:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666781824:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.771739:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6680f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666781696:12345-0@lo:400:kworker.0 Request processed in 1195us (2017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.771747:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789135953.771761:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789135953.771767:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.771796:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666782208:12345-0@lo:400:kworker.0 Request processed in 30us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.771801:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789135953.771811:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789135953.771816:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666782080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.771843:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666782080:12345-0@lo:400:kworker.0 Request processed in 27us (1931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.771848:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789135953.771900:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666781056:0@lo:400:kworker.0 00010000:00080000:3.0:1789135953.771912:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69ea1c0 x1876044666781568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135953.771923:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666781568:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.772344:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6682d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666782080:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.772370:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666781184:0@lo:400:kworker.0 00010000:00080000:3.0:1789135953.772381:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66812c0 x1876044666781696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135953.772390:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666781696:0@lo:400:kworker.0 00000100:00100000:3.0:1789135953.772399:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666782208:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.772671:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666780928:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.772694:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666781440:0@lo:400:kworker.0 00010000:00080000:2.0:1789135953.772705:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6681a40 x1876044666781952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135953.772715:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6681a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666781952:0@lo:400:kworker.0 00000100:00100000:2.0:1789135953.773346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666782336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135953.773394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135953.777828:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782336 00000100:00100000:3.0:1789135953.777846:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782336 00000100:00100000:3.0:1789135953.777927:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789135953.777948:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666782336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135953.777985:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135953.784754:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666782336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6792us (11345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135953.784775:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00080000:2.0:1789135953.786052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44b4000 x1876044666782336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135953.786237:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666782336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789135954.152326:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135954.280077:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666782464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135954.280161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135954.280337:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782464 00000100:00100000:0.0:1789135954.280345:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782464 00000100:00100000:0.0:1789135954.280398:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789135954.280407:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6681a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666782464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135954.280436:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135954.280483:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6681a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666782464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135954.280489:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789135954.280532:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666782464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135954.280798:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135954.280810:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666782592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135954.280837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135954.280935:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782592 00000100:00100000:3.0:1789135954.280940:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782592 00000100:00100000:3.0:1789135954.280971:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789135954.280981:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666782592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135954.280992:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135954.281021:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666782592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135954.281026:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789135954.281107:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666782592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135954.801722:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666782720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135954.801804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135954.801908:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782720 00000100:00100000:3.0:1789135954.803348:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782720 00000100:00100000:3.0:1789135954.803410:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135954.803420:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666782720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135954.803455:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135954.806073:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666782720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2646us (4260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135954.806096:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789135954.817272:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6683c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666782720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135955.193626:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135955.443483:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135955.443545:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135955.443580:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135955.443615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135955.443644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135955.443676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653056 00000100:00100000:3.0:1789135955.443688:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653056 00000100:00100000:3.0:1789135955.443753:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653312 00000100:00100000:3.0:1789135955.443756:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653312 00000100:00100000:3.0:1789135955.443773:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652928 00000100:00100000:3.0:1789135955.443775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652928 00000100:00100000:3.0:1789135955.443787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653184 00000100:00100000:3.0:1789135955.443789:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653184 00000100:00100000:3.0:1789135955.443806:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 341 00000100:00100000:3.0:1789135955.443817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6682d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644653056:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135955.443931:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6682d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644653056:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135955.443939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 341 00000100:00100000:3.0:1789135955.443957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 342 00000100:00100000:3.0:1789135955.443980:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6683c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644653312:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135955.444009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6683c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644653312:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135955.444015:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 342 00000100:00100000:3.0:1789135955.444028:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 343 00000100:00100000:3.0:1789135955.444034:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644652928:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135955.444060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644652928:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135955.444067:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 343 00000100:00100000:3.0:1789135955.444093:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 344 00000100:00100000:3.0:1789135955.444100:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644653184:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135955.444124:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644653184:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135955.444129:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 344 00000100:00080000:2.0:1789135955.444470:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135955.444476:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135955.444831:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644652800 00000100:00100000:0.0:1789135955.444837:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644652800 00000100:00100000:0.0:1789135955.444903:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 453 00000100:00100000:0.0:1789135955.444911:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644652800:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135955.444957:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644652800:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 47us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135955.444973:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 453 00010000:00010000:0.0:1789135956.200038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135957.225260:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135958.253251:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135958.376135:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666782848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789135958.376220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135958.376341:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782848 00000100:00100000:0.0:1789135958.376351:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782848 00000100:00100000:0.0:1789135958.376410:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789135958.376419:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666782848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135958.376452:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135958.376581:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666782848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135958.376590:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789135958.376674:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666782848:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1789135958.843178:0:14773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:12:36 (1789135956) 00000100:00100000:3.0:1789135958.888150:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666783104:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888217:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.888283:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666783616:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888303:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.888316:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666784128:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.888358:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789135958.888363:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666783232:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888393:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.888408:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666783744:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.888444:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666784256:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.888697:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783104 00000100:00100000:3.0:1789135958.888704:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783104 00000100:00100000:3.0:1789135958.888740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783616 00000100:00100000:3.0:1789135958.888742:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783616 00000100:00100000:3.0:1789135958.888760:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784128 00000100:00100000:3.0:1789135958.888775:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784128 00000100:00100000:3.0:1789135958.888787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783744 00000100:00100000:3.0:1789135958.888789:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783744 00000100:00100000:3.0:1789135958.888798:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784256 00000100:00100000:3.0:1789135958.888800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784256 00000100:00100000:3.0:1789135958.888813:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789135958.888821:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666783104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666783104:12345-0@lo:400:kworker.0 Request processed in 83us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.888912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789135958.888929:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789135958.888934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666783616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.888957:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666783616:12345-0@lo:400:kworker.0 Request processed in 23us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.888963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789135958.888971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789135958.888976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c23112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666784128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c23112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666784128:12345-0@lo:400:kworker.0 Request processed in 29us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.889011:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789135958.889021:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789135958.889026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666783744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889046:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666783744:12345-0@lo:400:kworker.0 Request processed in 20us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.889051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789135958.889058:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789135958.889064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666784256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889082:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666784256:12345-0@lo:400:kworker.0 Request processed in 18us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.889087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789135958.889109:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783232 00000100:00100000:3.0:1789135958.889112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783232 00000100:00100000:3.0:1789135958.889132:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135958.889137:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666783232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889162:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666783232:12345-0@lo:400:kworker.0 Request processed in 25us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135958.889167:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135958.889199:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666783232:0@lo:400:kworker.0 00010000:00080000:3.0:1789135958.889211:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b003c0 x1876044666783744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135958.889221:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666783744:0@lo:400:kworker.0 00010000:00080000:3.0:1789135958.889255:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe30c0 x1876044666784256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135958.889263:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666784256:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889273:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666783104:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889281:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666783616:0@lo:400:kworker.0 00000100:00100000:3.0:1789135958.889289:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666784128:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.889891:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666783360:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.889932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.889966:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666783872:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.889987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.890005:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666784384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.890041:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789135958.890047:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666782976:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890068:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.890089:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666783488:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.890121:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666784000:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890138:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.890149:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666784512:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135958.890193:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783872 00000100:00100000:1.0:1789135958.890197:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783872 00000100:00100000:1.0:1789135958.890223:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784384 00000100:00100000:1.0:1789135958.890225:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784384 00000100:00100000:1.0:1789135958.890248:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784000 00000100:00100000:1.0:1789135958.890251:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784000 00000100:00100000:1.0:1789135958.890262:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784512 00000100:00100000:1.0:1789135958.890264:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784512 00000100:00100000:1.0:1789135958.890421:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789135958.890439:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666783872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890484:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666783872:12345-0@lo:400:kworker.0 Request processed in 46us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.890490:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789135958.890508:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789135958.890514:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666784384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890540:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666784384:12345-0@lo:400:kworker.0 Request processed in 26us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.890545:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789135958.890557:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789135958.890562:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666784000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890585:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666784000:12345-0@lo:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.890591:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789135958.890601:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789135958.890606:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666784512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890630:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666784512:12345-0@lo:400:kworker.0 Request processed in 24us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.890635:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789135958.890658:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666782976 00000100:00100000:1.0:1789135958.890663:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666782976 00000100:00100000:1.0:1789135958.890685:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789135958.890691:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666782976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.890720:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666782976:12345-0@lo:400:kworker.0 Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.890735:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789135958.890845:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783488 00000100:00100000:1.0:1789135958.890944:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783488 00000100:00100000:1.0:1789135958.890978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789135958.890984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666783488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.891021:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666783488:12345-0@lo:400:kworker.0 Request processed in 38us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135958.891028:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789135958.891536:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666783360 00000100:00100000:0.0:1789135958.891541:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666783360 00000100:00100000:0.0:1789135958.891580:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789135958.891587:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666783360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135958.891636:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666783360:12345-0@lo:400:kworker.0 Request processed in 51us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135958.891643:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:2.0:1789135958.893050:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135958.893058:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135958.893062:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135958.893065:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789135958.893639:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666782976:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.893659:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666783488:0@lo:400:kworker.0 00010000:00080000:1.0:1789135958.893674:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f66ede00 x1876044666784000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135958.893684:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666784000:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.893696:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666784512:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.893708:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3f85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666783360:0@lo:400:kworker.0 00010000:00080000:1.0:1789135958.893718:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d90780 x1876044666783872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135958.893726:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666783872:0@lo:400:kworker.0 00000100:00100000:1.0:1789135958.893736:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666784384:0@lo:400:kworker.0 00000100:00100000:0.0:1789135958.898644:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666784640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135958.898719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135958.899201:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135958.899214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666784768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135958.899363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135958.900049:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784640 00000100:00100000:3.0:1789135958.900061:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784640 00000100:00100000:3.0:1789135958.900145:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784768 00000100:00100000:3.0:1789135958.900149:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784768 00000100:00100000:2.0:1789135958.900397:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135958.900411:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666784640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135958.900449:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135958.900522:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666784640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135958.900530:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789135958.900550:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135958.900557:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666784768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135958.900596:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135958.900625:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666784768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135958.900635:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00080000:0.0:1789135958.902826:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe2940 x1876044666784768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135958.902882:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666784768:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789135958.902920:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff64b840 x1876044666784640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789135974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135958.902935:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666784640:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789135959.272066:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135959.400049:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135959.400072:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666784896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135959.400148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135959.400443:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666784896 00000100:00100000:2.0:1789135959.400452:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666784896 00000100:00100000:2.0:1789135959.400508:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135959.400517:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666784896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135959.400555:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135959.400596:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666785024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135959.400608:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666784896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135959.400617:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789135959.400675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135959.400756:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666784896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135959.400774:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666785024 00000100:00100000:2.0:1789135959.400783:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666785024 00000100:00100000:2.0:1789135959.400819:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135959.400828:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666785024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789135959.400841:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135959.400922:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666785024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135959.400929:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789135959.401346:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666785024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135959.913003:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135959.913038:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c446c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666785152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135959.913136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135959.913297:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666785152 00000100:00100000:1.0:1789135959.913312:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666785152 00000100:00100000:1.0:1789135959.913398:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789135959.913423:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666785152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135959.913464:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135959.913548:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666785152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135959.913556:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789135959.914346:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c446c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666785152:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789135960.296132:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135960.561970:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135960.562052:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135960.562102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135960.562140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135960.563001:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653440 00000100:00100000:2.0:1789135960.563012:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653440 00000100:00100000:3.0:1789135960.563266:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135960.563529:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 455 00000100:00100000:2.0:1789135960.563542:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644653440:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135960.563617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644653440:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 78us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135960.563624:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 455 00000100:00100000:3.0:1789135960.570800:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653696 00000100:00100000:3.0:1789135960.570825:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653696 00000100:00100000:3.0:1789135960.570933:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653952 00000100:00100000:3.0:1789135960.570937:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653952 00000100:00100000:3.0:1789135960.570967:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653568 00000100:00100000:3.0:1789135960.570971:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653568 00000100:00100000:3.0:1789135960.570989:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644653824 00000100:00100000:3.0:1789135960.570993:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644653824 00000100:00100000:3.0:1789135960.571021:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 351 00000100:00100000:3.0:1789135960.571034:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644653696:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135960.571146:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644653696:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 114us (9093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135960.571174:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 351 00000100:00100000:3.0:1789135960.571196:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 352 00000100:00100000:3.0:1789135960.571214:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644653952:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135960.571245:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644653952:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 43us (9153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135960.571252:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 352 00000100:00100000:3.0:1789135960.571263:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 353 00000100:00100000:3.0:1789135960.571269:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644653568:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135960.571294:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644653568:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (9163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135960.571301:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 353 00000100:00100000:3.0:1789135960.571311:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 354 00000100:00100000:3.0:1789135960.571317:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644653824:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135960.571340:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644653824:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (8078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135960.571345:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 354 00000100:00080000:3.0:1789135960.577695:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135960.577709:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135960.946332:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135960.946708:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654080 00000100:00100000:3.0:1789135960.946721:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654080 00000100:00100000:3.0:1789135960.947606:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1789135960.947623:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:11346:x1876044644654080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135960.947655:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135960.948018:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08930 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135960.948110:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de2d50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135960.948210:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de2d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135960.948228:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de2d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135960.948275:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789135960.948279:0:14529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135960.948315:0:14529:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de2d50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135960.948357:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08930 expref: 7 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135960.948605:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de2d50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08930 expref: 6 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135960.948615:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5a0a00) 00010000:00010000:3.0:1789135960.948617:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135960.948621:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf400, rc 0) 00000100:00100000:3.0:1789135960.949619:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+6:11346:x1876044644654080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1992us (3296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135960.949631:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1789135960.966395:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135960.969884:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654208 00000100:00100000:0.0:1789135960.969919:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654208 00000100:00100000:0.0:1789135960.970183:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:0.0:1789135960.970206:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:11347:x1876044644654208:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135960.970227:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135960.970264:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08937 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.970329:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.970344:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975652:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975711:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975724:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975732:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975803:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2d6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975812:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2d6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975819:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2d6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135960.975908:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789135960.975913:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135960.975942:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2d6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975954:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975960:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975967:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.975996:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135960.976000:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976009:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976029:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5a0a00) 00010000:00010000:0.0:1789135960.976032:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135960.976037:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976043:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976063:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976069:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976075:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976079:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135960.976082:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976088:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976106:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a7fa59f400) 00010000:00010000:0.0:1789135960.976109:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135960.976112:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976118:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2d65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976164:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08937 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976180:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2d6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08937 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135960.976187:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7fa59fb00) 00010000:00010000:0.0:1789135960.976189:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135960.976192:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030a00, rc 0) 00000100:00100000:0.0:1789135960.978742:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11347:x1876044644654208:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 8536us (12343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135960.978758:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:0.0:1789135960.985733:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135960.986183:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654336 00000100:00100000:3.0:1789135960.986211:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654336 00000100:00100000:3.0:1789135960.986284:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789135960.986296:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11347:x1876044644654336:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789135960.986401:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11347:x1876044644654336:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 Request processed in 108us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135960.986408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1789135961.008698:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135961.008915:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654592 00000100:00100000:0.0:1789135961.008929:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654592 00000100:00100000:1.0:1789135961.009134:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:1.0:1789135961.009166:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11347:x1876044644654592:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135961.009204:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135961.009234:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2d73 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0893e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009319:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009335:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009349:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009416:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009639:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009648:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009782:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de2d88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009791:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de2d88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009798:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de2d88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135961.009809:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789135961.009945:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009953:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009960:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009966:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135961.009971:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009979:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.009993:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7fa59fb00) 00010000:00010000:1.0:1789135961.009996:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135961.010539:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010562:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2d7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010579:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010585:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010592:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010597:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135961.010602:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010609:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010618:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a6c2b0f300) 00010000:00010000:1.0:1789135961.010621:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135961.010624:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.010630:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2d81 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.012137:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de2d73 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0893e expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.012169:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de2d88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0893e expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135961.012203:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:1.0:1789135961.012206:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135961.012210:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878800, rc 0) 00000100:00100000:1.0:1789135961.012291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11347:x1876044644654592:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 3140us (3609us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789135961.012301:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:0.0:1789135961.018611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135961.018948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654720 00000100:00100000:3.0:1789135961.018963:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654720 00000100:00100000:3.0:1789135961.020002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1789135961.020052:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11347:x1876044644654720:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789135961.020203:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11347:x1876044644654720:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 174us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135961.020212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:0.0:1789135961.028732:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135961.028927:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654848 00000100:00100000:3.0:1789135961.028937:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654848 00000100:00100000:3.0:1789135961.028997:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1789135961.029009:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:11347:x1876044644654848:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789135961.032745:0:8299:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3668us 00000100:00100000:3.0:1789135961.070232:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:11347:x1876044644654848:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 41216us (41511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135961.070246:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00010000:00010000:2.0:1789135961.325842:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135961.385570:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789135961.448911:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789135962.344467:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135963.375416:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135963.432655:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789135963.496697:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789135963.497074:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666785280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135963.497212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135963.497629:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666785280 00000100:00100000:0.0:1789135963.497637:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666785280 00000100:00100000:0.0:1789135963.497689:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789135963.497699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666785280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135963.497733:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789135963.497793:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666785280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.497800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789135963.497916:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666785280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135963.667645:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135963.668243:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644654976 00000100:00100000:3.0:1789135963.668255:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644654976 00000100:00100000:3.0:1789135963.668464:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:3.0:1789135963.668476:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11390:x1876044644654976:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135963.668499:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135963.668537:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08945 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668604:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668619:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668630:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668644:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668651:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668658:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668703:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668711:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668718:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668736:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135963.668740:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668748:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668760:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5a0a00) 00010000:00010000:3.0:1789135963.668764:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.668768:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668774:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668786:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668792:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668798:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668803:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135963.668805:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668811:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668829:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a7e0aa7800) 00010000:00010000:3.0:1789135963.668832:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.668835:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668840:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2da4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668898:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2d96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08945 expref: 10 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.668908:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5a0a00) 00010000:00010000:3.0:1789135963.668911:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.668914:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08945 expref: 10 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.669046:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf200, rc 0) 00000100:00100000:3.0:1789135963.669114:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11390:x1876044644654976:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 640us (1482us total) trans 0 rc 301/301 00000100:00100000:3.0:1789135963.669121:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00080000:2.0:1789135963.672017:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135963.678248:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135963.678321:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644655232 00000100:00100000:1.0:1789135963.678335:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644655232 00000100:00100000:1.0:1789135963.678411:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:1.0:1789135963.678431:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11390:x1876044644655232:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:1.0:1789135963.678490:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135963.678518:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de2d50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08930 expref: 9 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.678536:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5a0a00) 00010000:00010000:1.0:1789135963.678547:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135963.678612:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.678626:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.678634:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.678646:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.678668:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.678675:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679253:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679264:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679271:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135963.679287:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000030ab8a74 reply state 0000000033a678cc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679301:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679307:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135963.679310:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135963.679312:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789135963.679317:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789135963.679324:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679331:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679339:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679352:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135963.679356:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679366:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679375:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a6c2b0f300) 00010000:00010000:1.0:1789135963.679377:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135963.679381:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679387:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de2dab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135963.679402:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000030ab8a74 reply state 0000000033a678cc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679410:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.679416:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135963.679419:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135963.679421:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789135963.679524:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+10:11390:x1876044644655232:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 1102us (1297us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789135963.679532:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:0.0:1789135963.835222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135963.835317:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644655360 00000100:00100000:3.0:1789135963.835328:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644655360 00000100:00100000:3.0:1789135963.835395:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1789135963.835406:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+10:11398:x1876044644655360:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:3.0:1789135963.835443:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135963.835468:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0894c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.835553:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2dc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.835568:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.835580:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135963.835626:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789135963.835629:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135963.835670:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.835695:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0894c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.835712:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0894c expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.835722:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:3.0:1789135963.835725:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135963.835728:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae800, rc 0) 00000100:00100000:3.0:1789135963.836200:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+11:11398:x1876044644655360:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 793us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135963.836209:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:2.0:1789135963.897993:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135963.898159:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644655488 00000100:00100000:0.0:1789135963.898169:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644655488 00000100:00100000:0.0:1789135963.898239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1789135963.898249:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+11:11404:x1876044644655488:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135963.898281:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135963.898305:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2dce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08953 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898372:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898400:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898413:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898424:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898431:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898452:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898531:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2de3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898539:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898545:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135963.898582:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789135963.898586:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135963.898626:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2de3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898638:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898644:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898651:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898657:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135963.898660:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898667:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898686:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:0.0:1789135963.898688:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135963.898693:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898699:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898713:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898719:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898724:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898729:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135963.898732:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898737:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898744:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a6c2b0f000) 00010000:00010000:0.0:1789135963.898746:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135963.898749:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898755:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2ddc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898795:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2dce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08953 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898807:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2de3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08953 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.898815:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135963.898817:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789135963.898819:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031800, rc 0) 00000100:00100000:0.0:1789135963.898965:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+12:11404:x1876044644655488:12345-192.168.201.31@tcp:101:bash.0 Request processed in 716us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.898972:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:1.0:1789135963.905139:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135963.905264:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644655744 00000100:00100000:3.0:1789135963.905284:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644655744 00000100:00100000:3.0:1789135963.905398:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:3.0:1789135963.905409:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+12:11404:x1876044644655744:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135963.905441:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135963.905464:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2dea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0895a expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.905579:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.905594:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.905619:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.905688:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.905696:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.905704:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135963.906749:0:14529:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789135963.906915:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.906928:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.906936:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.906981:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.906987:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.906999:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907005:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135963.907009:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907017:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907030:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135963.907033:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135963.907038:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907044:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2df1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135963.907057:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009d71cdd9 reply state 00000000c9165a02 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907069:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907074:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:3.0:1789135963.907082:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135963.907085:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135963.907118:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de2dea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 15 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907129:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 14 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.907133:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135963.907135:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135963.907136:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:3.0:1789135963.907896:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11404:x1876044644655744:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2448us (2727us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789135963.907906:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:1.0:1789135963.915964:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135963.916048:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644655872 00000100:00100000:3.0:1789135963.916057:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644655872 00000100:00100000:3.0:1789135963.916095:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1789135963.916102:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644655872:12345-192.168.201.31@tcp:8:bash.0 00010000:00080000:3.0:1789135963.916132:0:8536:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1789135963.916180:0:8536:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de2e0d 00002000:00100000:3.0:1789135963.916194:0:8536:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 50163b70-8f7a-42d3-bcbf-652648370aa8/ffff90a6c44bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789135963.916213:0:8536:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789135963.916302:0:8536:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789135963.916335:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a6c44ba000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789135963.916493:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644655872:12345-192.168.201.31@tcp:8:bash.0 Request processed in 389us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135963.916501:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:2.0:1789135963.919834:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135963.920078:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644656000 00000100:00100000:0.0:1789135963.920088:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644656000 00000100:00100000:0.0:1789135963.920214:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789135963.920224:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644656000:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135963.920241:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135963.920266:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08961 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135963.920291:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789135963.920310:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1789135963.920315:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135963.920325:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.920368:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.920396:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030400, rc 0) 00000100:00100000:0.0:1789135963.920460:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:0:x1876044644656000:12345-192.168.201.31@tcp:101:bash.0 Request processed in 237us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.920467:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00080000:2.0:1789135963.923534:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135963.924366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135963.924509:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644656128 00000100:00100000:3.0:1789135963.924519:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644656128 00000100:00100000:3.0:1789135963.924587:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789135963.924596:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11404:x1876044644656128:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135963.924615:0:8536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135963.924636:0:8536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08968 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.924665:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.924674:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135963.924678:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135963.924683:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.924717:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135963.924731:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 8 pid: 8430 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135963.924745:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8536:1876044666785408:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135963.924877:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135963.928440:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135963.928637:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644656256 00000100:00100000:0.0:1789135963.928646:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644656256 00010000:00010000:0.0:1789135963.928688:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 9 pid: 8430 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135963.928733:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:0.0:1789135963.928743:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644656256:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135963.928757:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135963.928777:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 9 pid: 8430 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.928790:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 9 pid: 8430 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.928816:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135963.928820:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135963.928829:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.928892:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135963.929006:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135963.929021:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1876044666785536:192.168.201.31@tcp:105: 00000100:00100000:0.0:1789135963.929104:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2481300 going to sleep for 11 seconds 00010000:00010000:1.0:1789135963.929211:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa8043b/0x559c8745c6de2e14 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08961 expref: 9 pid: 8430 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135963.929238:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8536:1876044666785408:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135963.929264:0:8536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135963.929276:0:8536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf200, rc 0) 00000100:00100000:1.0:1789135963.929307:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:11404:x1876044644656128:12345-192.168.201.31@tcp:101:bash.0 Request processed in 4712us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135963.929315:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1789135963.933396:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1876044666785536:192.168.201.31@tcp:105: 00010000:00010000:0.0:1789135963.933422:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135963.933483:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644656256:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 4741us (5062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135963.933495:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:2.0:1789135963.937787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135963.937887:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644656512 00000100:00100000:3.0:1789135963.937908:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644656512 00000100:00100000:3.0:1789135963.937976:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:3.0:1789135963.937986:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11404:x1876044644656512:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:3.0:1789135963.938282:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11404:x1876044644656512:12345-192.168.201.31@tcp:35:bash.0 Request processed in 296us (503us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789135963.938290:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1789135964.008242:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135964.008271:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666785664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135964.008347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135964.008671:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666785664 00000100:00100000:2.0:1789135964.008678:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666785664 00000100:00100000:2.0:1789135964.008736:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789135964.008749:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666785664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135964.008771:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135964.008816:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666785664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.008840:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1789135964.008886:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135964.009007:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135964.009020:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666785792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135964.009055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135964.009306:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666786176:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.009338:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135964.009360:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666786688:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009470:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666785920:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009505:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.009531:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666786432:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009555:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.009570:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666786944:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.009618:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789135964.009624:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666786048:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009646:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.009660:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666786560:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.009692:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666787072:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009715:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.009741:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786944 00000100:00100000:3.0:1789135964.009746:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786944 00000100:00100000:3.0:1789135964.009784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786048 00000100:00100000:3.0:1789135964.009794:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786048 00000100:00100000:3.0:1789135964.009814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786560 00000100:00100000:3.0:1789135964.009817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786560 00000100:00100000:3.0:1789135964.009836:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789135964.009843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666786944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666786944:12345-0@lo:400:kworker.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.009911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789135964.009941:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789135964.009946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.009975:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666786048:12345-0@lo:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.009981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789135964.009992:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789135964.009998:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666786560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.010024:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666786560:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.010030:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789135964.010069:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666786048:0@lo:400:kworker.0 00000100:00100000:3.0:1789135964.010080:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666786560:0@lo:400:kworker.0 00010000:00080000:3.0:1789135964.010092:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d0387840 x1876044666786944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135964.010102:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666786944:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135964.010307:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d03852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666787200:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135964.010352:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789135964.010358:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666786304:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135964.010412:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666786816:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010434:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135964.010461:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786176 00000100:00100000:1.0:1789135964.010464:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786176 00000100:00100000:1.0:1789135964.010494:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786432 00000100:00100000:1.0:1789135964.010497:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786432 00000100:00100000:1.0:1789135964.010524:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789135964.010530:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666786176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010570:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666786176:12345-0@lo:400:kworker.0 Request processed in 40us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.010576:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789135964.010592:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789135964.010598:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666786432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010629:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666786432:12345-0@lo:400:kworker.0 Request processed in 31us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.010634:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789135964.010656:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666787072 00000100:00100000:1.0:1789135964.010659:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666787072 00000100:00100000:1.0:1789135964.010684:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666787200 00000100:00100000:1.0:1789135964.010687:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666787200 00000100:00100000:1.0:1789135964.010707:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789135964.010713:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666787072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010745:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666787072:12345-0@lo:400:kworker.0 Request processed in 31us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.010751:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789135964.010763:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135964.010768:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666787200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.010794:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666787200:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.010800:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789135964.010816:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786688 00000100:00100000:1.0:1789135964.010819:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786688 00000100:00100000:1.0:1789135964.010837:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786304 00000100:00100000:1.0:1789135964.010846:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786304 00000100:00100000:1.0:1789135964.010880:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666786816 00000100:00100000:1.0:1789135964.010883:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666786816 00000100:00100000:1.0:1789135964.010899:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789135964.010905:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666786688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135964.011108:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666785920 00000100:00100000:0.0:1789135964.011114:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666785920 00000100:00100000:0.0:1789135964.011154:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789135964.011161:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666785920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135964.011197:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666785920:12345-0@lo:400:kworker.0 Request processed in 38us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.011203:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789135964.011236:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789135964.011250:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666786304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135964.011282:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666786304:12345-0@lo:400:kworker.0 Request processed in 34us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.011288:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789135964.011304:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789135964.011310:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666786816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135964.011336:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666786816:12345-0@lo:400:kworker.0 Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.011342:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789135964.011408:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666785664:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135964.011609:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666785792 00000100:00100000:2.0:1789135964.011614:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666785792 00000100:00100000:2.0:1789135964.011661:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135964.011668:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666785792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135964.011682:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135964.011716:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666785792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.011723:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1789135964.011750:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789135964.011753:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789135964.011757:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135964.011759:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135964.011902:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666786688:12345-0@lo:400:kworker.0 Request processed in 997us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135964.011910:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789135964.012165:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666787072:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012176:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666785920:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012190:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666786432:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012230:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666786304:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012240:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666786816:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012251:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666786176:0@lo:400:kworker.0 00010000:00080000:1.0:1789135964.012263:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ff70c0 x1876044666786688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135964.012273:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666786688:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012284:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d03852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666787200:0@lo:400:kworker.0 00000100:00100000:1.0:1789135964.012301:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666785792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789135964.053030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.053118:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644656768 00000100:00100000:0.0:1789135964.053127:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644656768 00000100:00100000:0.0:1789135964.053224:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:0.0:1789135964.053235:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11414:x1876044644656768:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135964.053261:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135964.053283:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2e22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0896f expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135964.053395:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789135964.053669:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2e22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0896f expref: 18 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.053684:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:0.0:1789135964.053688:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135964.053693:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2e22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0896f expref: 18 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.053728:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:0.0:1789135964.053792:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+17:11414:x1876044644656768:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 558us (772us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1789135964.053800:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:2.0:1789135964.059643:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.059978:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644657024 00000100:00100000:3.0:1789135964.059989:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644657024 00000100:00100000:3.0:1789135964.060060:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789135964.060070:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+17:11414:x1876044644657024:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135964.060317:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:11414:x1876044644657024:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 248us (685us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789135964.060325:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1789135964.178617:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.178726:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644657152 00000100:00100000:0.0:1789135964.178737:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644657152 00000100:00100000:0.0:1789135964.178801:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:0.0:1789135964.178812:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+18:11420:x1876044644657152:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135964.178835:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135964.178902:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08976 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.178974:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2e37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.178988:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2e37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.178999:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2e37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135964.179044:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789135964.179049:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135964.179071:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2e37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.179309:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08976 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.179351:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2e37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08976 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.179361:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135964.179364:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135964.179367:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031200, rc 0) 00000100:00100000:0.0:1789135964.179446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11420:x1876044644657152:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 635us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.179454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1789135964.205341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135964.205521:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644657408 00000100:00100000:1.0:1789135964.205532:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644657408 00000100:00100000:1.0:1789135964.205607:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:1.0:1789135964.205618:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11420:x1876044644657408:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135964.205654:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135964.205676:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2e3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0897d expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.205792:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2e45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.205807:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.205819:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2e45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135964.205830:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789135964.205981:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de2e3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0897d expref: 22 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.206001:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2e45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0897d expref: 21 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135964.206010:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135964.206013:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135964.206016:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135964.206092:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:11420:x1876044644657408:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 466us (755us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789135964.206100:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:3.0:1789135964.213157:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.213241:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644657664 00000100:00100000:2.0:1789135964.213258:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644657664 00000100:00100000:2.0:1789135964.213429:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:2.0:1789135964.213441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+21:11420:x1876044644657664:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135964.213469:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135964.213491:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08984 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.213600:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de2e5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.213630:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de2e5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.213642:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de2e5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135964.213657:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789135964.213766:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08984 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.213785:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de2e5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08984 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.213794:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:2.0:1789135964.213797:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135964.213801:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4600, rc 0) 00000100:00100000:2.0:1789135964.213914:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+23:11420:x1876044644657664:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 475us (784us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789135964.213922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:2.0:1789135964.219042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.220583:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644657792 00000100:00100000:0.0:1789135964.220596:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644657792 00000100:00100000:0.0:1789135964.220673:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:0.0:1789135964.220684:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+23:2389:x1876044644657792:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135964.220697:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135964.220721:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de2e45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0897d expref: 23 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.220740:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135964.220745:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135964.220809:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:2389:x1876044644657792:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 128us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.220817:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1789135964.229197:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.229352:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644657920 00000100:00100000:2.0:1789135964.229468:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644657920 00000100:00100000:2.0:1789135964.229558:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:2.0:1789135964.229572:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644657920:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:2.0:1789135964.229636:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.230064:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 7 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.230077:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135964.230083:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135964.230088:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.230147:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 7 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.230165:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 7 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.230184:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1876044666787328:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135964.230325:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789135964.240448:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1876044666787328:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135964.240497:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135964.242566:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.243522:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644658048 00000100:00100000:0.0:1789135964.243534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644658048 00002000:00100000:0.0:1789135964.243587:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff90a7c69ea1c0 x1876044644658048/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:395/0 lens 504/0 e 0 to 0 dl 1789135975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135964.243612:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7c69ea1c0 with x1876044644658048 ext(0->12) 00010000:00010000:0.0:1789135964.243623:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 8 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.243641:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 8 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135964.243649:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a7c69ea1c0 00000100:00100000:0.0:1789135964.243693:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1789135964.243703:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644658048:12345-192.168.201.31@tcp:4:lfs.0 00000001:00100000:3.0:1789135964.250779:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000100:00100000:0.0:1789135964.255036:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644658048:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 11322us (12468us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789135964.255307:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00002000:00100000:0.0:1789135964.255325:0:8435:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff90a7c69ea1c0 x1876044644658048/t4294967300(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:395/0 lens 504/448 e 0 to 0 dl 1789135975 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135964.255335:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7c69ea1c0 with x1876044644658048 ext(0->12) 00010000:00010000:0.0:1789135964.255347:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.255365:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135964.255378:0:8435:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a7c69ea1c0 00000100:00100000:1.0:1789135964.261588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.264942:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644658176 00000100:00100000:0.0:1789135964.264980:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644658176 00010000:00010000:0.0:1789135964.265034:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135964.265097:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:0.0:1789135964.265108:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2390:x1876044644658176:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135964.265123:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789135964.265153:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789135964.265157:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789135963 00002000:00010000:0.0:1789135964.265159:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789135963 00002000:00010000:0.0:1789135964.265161:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789135963 00002000:00010000:0.0:1789135964.265164:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789135964.265171:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.265186:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.265210:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e917d6/0x559c8745c6de2e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08968 expref: 9 pid: 8536 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.265228:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135964.265233:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135964.265239:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.265251:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.265293:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135964.265364:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2390:x1876044644658176:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 257us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.265380:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00010000:00010000:2.0:1789135964.265454:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265466:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265495:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265503:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265511:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265519:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135964.265523:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265532:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265547:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.265555:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de2e68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.265607:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644657920:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 36039us (36422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.265616:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:1.0:1789135964.273644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.273844:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644658432 00000100:00100000:3.0:1789135964.273889:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644658432 00000100:00100000:3.0:1789135964.273937:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1789135964.273948:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+22:11420:x1876044644658432:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:3.0:1789135964.274012:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de2e5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08984 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135964.274247:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789135964.274300:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789135964.274682:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789135964.274722:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.274753:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 26 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.274764:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.274799:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 26 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.274813:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 26 pid: 14529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.274828:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1876044666787456:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135964.274932:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789135964.279594:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.279630:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1876044666787456:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135964.279666:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135964.282326:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644658560 00000100:00100000:0.0:1789135964.282341:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644658560 00010000:00010000:0.0:1789135964.282404:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 27 pid: 14529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135964.282650:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:0.0:1789135964.282661:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+27:2392:x1876044644658560:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135964.282678:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135964.282685:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 27 pid: 14529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.282697:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 27 pid: 14529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.282721:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de2dff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0895a expref: 27 pid: 14529 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.282740:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135964.282745:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.282754:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.282791:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.282830:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135964.282946:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+26:2392:x1876044644658560:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 286us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.282954:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00010000:00010000:3.0:1789135964.283097:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.283105:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135964.283256:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1789135964.283365:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1789135964.283729:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1876044666787584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789135964.283897:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.283937:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c12ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135964.284659:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666787584 00000100:00100000:0.0:1789135964.284669:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666787584 00000100:00100000:0.0:1789135964.284713:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789135964.284722:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876044666787584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135964.285148:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876044666787584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 426us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.285156:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789135964.285334:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1876044666787584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789135964.285948:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789135964.286028:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1876044666787712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789135964.286177:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.286208:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135964.286307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666787712 00000100:00100000:0.0:1789135964.286313:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666787712 00000100:00100000:0.0:1789135964.286348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789135964.286356:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876044666787712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789135964.287115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1876044666787712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 756us (935us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789135964.287124:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789135964.287233:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1876044666787712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789135964.287290:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1789135964.287333:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.287343:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.287351:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.287357:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135964.287361:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.287380:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.287398:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135964.287401:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789135964.287405:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.287411:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de2e6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135964.287550:0:6519:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789135964.287608:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789135964.287619:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412406764030ns, next at 413406762170ns, rc = 0 00000001:00080000:3.0:1789135964.287625:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1789135964.287646:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135964.287649:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789135964.287656:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de2e5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08984 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135964.287746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+29:11420:x1876044644658432:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 13800us (14115us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1789135964.287755:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000020:00080000:3.0:1789135964.287758:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789135964.291150:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.291231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644658688 00000100:00100000:3.0:1789135964.291241:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644658688 00000100:00100000:3.0:1789135964.291301:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:3.0:1789135964.291312:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+29:11420:x1876044644658688:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135964.291336:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135964.291362:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2e76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0898b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.291434:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2e76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0898b expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.291450:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2e76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0898b expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.291490:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135964.291493:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135964.291496:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae200, rc 0) 00000100:00100000:3.0:1789135964.291557:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+30:11420:x1876044644658688:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 247us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.291564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:1.0:1789135964.299149:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.301562:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644658944 00000100:00100000:0.0:1789135964.301577:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644658944 00000100:00100000:2.0:1789135964.302578:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:2.0:1789135964.302591:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+30:11420:x1876044644658944:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1789135964.302895:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+31:11420:x1876044644658944:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 305us (3842us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789135964.302903:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00010000:00010000:2.0:1789135964.399302:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135964.449456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.460773:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644659200 00000100:00100000:3.0:1789135964.460788:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644659200 00000100:00100000:2.0:1789135964.461289:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:2.0:1789135964.461300:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+31:11430:x1876044644659200:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135964.461326:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135964.461347:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08992 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135964.461460:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789135964.461563:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2e7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08992 expref: 33 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.461579:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:2.0:1789135964.461582:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135964.461587:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08992 expref: 33 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.461602:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5400, rc 0) 00000100:00100000:2.0:1789135964.461806:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11430:x1876044644659200:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 437us (12287us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789135964.461815:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:1.0:1789135964.468219:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.469348:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644659328 00000100:00100000:2.0:1789135964.469360:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644659328 00000100:00100000:2.0:1789135964.469477:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:2.0:1789135964.469489:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11430:x1876044644659328:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1789135964.469572:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469589:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469616:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469629:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469638:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469645:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469728:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469737:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469744:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135964.469799:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469812:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469819:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469826:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469883:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135964.469889:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469897:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469912:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:2.0:1789135964.469914:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135964.469919:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469925:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2e8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469939:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469945:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469950:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469955:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135964.469958:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469965:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.469982:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:2.0:1789135964.469985:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135964.470064:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470073:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470084:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470089:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470095:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470099:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135964.470102:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470108:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470116:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:2.0:1789135964.470119:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135964.470122:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.470127:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de2e99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135964.470225:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11430:x1876044644659328:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 737us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.470234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1789135964.473565:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.473666:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644659584 00000100:00100000:2.0:1789135964.473676:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644659584 00000100:00100000:2.0:1789135964.473775:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1789135964.473787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11430:x1876044644659584:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1789135964.474141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+33:11430:x1876044644659584:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 346us (575us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789135964.474150:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:1.0:1789135964.520544:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135964.520570:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666787840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135964.520665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135964.520813:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666787840 00000100:00100000:0.0:1789135964.520821:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666787840 00000100:00100000:0.0:1789135964.520913:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789135964.520923:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666787840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135964.520971:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135964.521035:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666787840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135964.521042:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789135964.521088:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666787840:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135964.528498:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135964.528527:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666787968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135964.528610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135964.529064:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666787968 00000100:00100000:3.0:1789135964.529074:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666787968 00000100:00100000:3.0:1789135964.529122:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789135964.529141:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666787968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135964.529169:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135964.529227:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666787968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.529234:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789135964.530551:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666787968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135964.544501:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.544573:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644659840 00000100:00100000:3.0:1789135964.544581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644659840 00000100:00100000:3.0:1789135964.544639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:3.0:1789135964.544646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+33:11433:x1876044644659840:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135964.544667:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135964.544684:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2ea0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08999 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.544959:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.544986:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.544998:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545011:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545018:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545024:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545144:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545153:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545159:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135964.545168:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789135964.545248:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545254:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545261:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545274:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135964.545279:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545287:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545299:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135964.545302:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135964.545308:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545314:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2ea7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545326:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545329:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545333:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545336:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135964.545338:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545341:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545355:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:3.0:1789135964.545356:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135964.545358:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545362:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2eae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545392:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2ea0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545400:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 35 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.545405:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135964.545406:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135964.545408:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf800, rc 0) 00000100:00100000:3.0:1789135964.545467:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+35:11433:x1876044644659840:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 821us (974us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789135964.545472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1789135964.548539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.548637:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644659968 00000100:00100000:3.0:1789135964.548647:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644659968 00000100:00100000:3.0:1789135964.548707:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1789135964.548717:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+35:11433:x1876044644659968:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1789135964.548807:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548822:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548840:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548910:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548918:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548925:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548931:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135964.548936:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548944:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548956:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135964.548959:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135964.548965:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.548973:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ec3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135964.549050:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+35:11433:x1876044644659968:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 334us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.549058:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:1.0:1789135964.558613:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.558708:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644660224 00000100:00100000:3.0:1789135964.558722:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644660224 00000100:00100000:3.0:1789135964.558839:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:3.0:1789135964.558850:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+35:11433:x1876044644660224:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135964.559141:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+36:11433:x1876044644660224:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 283us (531us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789135964.559150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1789135964.835464:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.835643:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644660480 00000100:00100000:0.0:1789135964.835657:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644660480 00000100:00100000:0.0:1789135964.835741:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:0.0:1789135964.835753:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+36:11464:x1876044644660480:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:0.0:1789135964.835796:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135964.835826:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2eca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089a0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.836053:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ed1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.836072:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.836085:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135964.836100:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789135964.836308:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2eca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a0 expref: 39 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.836333:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a0 expref: 38 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.836354:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135964.836357:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135964.836362:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031a00, rc 0) 00000100:00100000:0.0:1789135964.836447:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11464:x1876044644660480:12345-192.168.201.31@tcp:101:cat.0 Request processed in 695us (998us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789135964.836455:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:1.0:1789135964.845719:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.846212:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644660608 00000100:00100000:2.0:1789135964.846227:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644660608 00000100:00100000:2.0:1789135964.846321:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1789135964.846334:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+38:2390:x1876044644660608:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135964.846354:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135964.846400:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ed1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a0 expref: 38 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135964.846426:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:2.0:1789135964.846433:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135964.846535:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+37:2390:x1876044644660608:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 203us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135964.846543:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1789135964.847424:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135964.847640:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644660864 00000100:00100000:2.0:1789135964.847648:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644660864 00000100:00100000:2.0:1789135964.847701:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1789135964.847710:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+37:11464:x1876044644660864:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:2.0:1789135964.848322:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11464:x1876044644660864:12345-192.168.201.31@tcp:35:cat.0 Request processed in 611us (959us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789135964.848332:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:3.0:1789135964.920690:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.920915:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644661120 00000100:00100000:0.0:1789135964.920929:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644661120 00000100:00100000:0.0:1789135964.921022:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:0.0:1789135964.921033:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11470:x1876044644661120:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:0.0:1789135964.921066:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135964.921070:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789135964.921111:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2e37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08976 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.921146:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135964.921153:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135964.921170:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2edf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089a7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.921309:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.921325:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.921358:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.921399:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.921416:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 38 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135964.921443:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666788096:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135964.921584:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c24810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135964.931748:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.931937:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666788096:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135964.931983:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135964.932254:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644661248 00000100:00100000:3.0:1789135964.932263:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644661248 00010000:00010000:3.0:1789135964.932314:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 39 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135964.932370:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1789135964.932382:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+39:2392:x1876044644661248:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135964.932401:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135964.932409:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 39 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.932422:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 39 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.932450:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2eb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08999 expref: 39 pid: 6516 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.932469:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135964.932475:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.932504:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.932513:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.932545:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135964.932733:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.932742:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135964.932769:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789135964.933022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2edf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.933041:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.933061:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135964.933064:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135964.933067:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031600, rc 0) 00000100:00100000:3.0:1789135964.933166:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+39:2392:x1876044644661248:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 785us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.933176:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:0.0:1789135964.934327:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11470:x1876044644661120:12345-192.168.201.31@tcp:101:dd.0 Request processed in 13286us (13643us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789135964.934339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1789135964.939181:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135964.939261:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644661376 00000100:00100000:3.0:1789135964.939274:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644661376 00000100:00100000:3.0:1789135964.939366:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:3.0:1789135964.939379:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11470:x1876044644661376:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:3.0:1789135964.939412:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135964.939455:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ef4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089ae expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.939499:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.939516:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.939530:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.939694:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2ef4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 40 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.939727:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 39 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135964.939736:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135964.939740:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135964.939744:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae000, rc 0) 00000100:00100000:3.0:1789135964.939835:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+39:11470:x1876044644661376:12345-192.168.201.31@tcp:101:dd.0 Request processed in 459us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135964.939843:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1789135964.944247:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135964.944493:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644661632 00000100:00100000:0.0:1789135964.944507:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644661632 00000100:00100000:0.0:1789135964.944591:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:0.0:1789135964.944603:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+39:11470:x1876044644661632:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:0.0:1789135964.945014:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.945039:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.945055:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135964.945114:0:8299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789135964.945154:0:8299:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000063a26510 reply state 00000000b3e3e7e7 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.945168:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135964.945176:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135964.945179:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135964.945202:0:8299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135964.947648:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+42:11470:x1876044644661632:12345-192.168.201.31@tcp:36:dd.0 Request processed in 3028us (3399us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789135964.947664:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000020:00080000:0.0:1789135964.947674:0:8299:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789135965.036906:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666788224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135965.037024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135965.037191:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666788224 00000100:00100000:1.0:1789135965.037201:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666788224 00000100:00100000:1.0:1789135965.037271:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789135965.037283:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666788224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135965.037328:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135965.046502:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666788224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9206us (9463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135965.046523:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789135965.048191:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666788224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135965.214155:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.214288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644661760 00000100:00100000:3.0:1789135965.214306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644661760 00000100:00100000:3.0:1789135965.214527:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:3.0:1789135965.214540:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+42:11484:x1876044644661760:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:3.0:1789135965.214563:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135965.214594:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089b5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214676:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214690:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214712:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214735:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214750:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214758:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214959:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214970:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.214978:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.215013:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.215027:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 43 pid: 6515 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.215042:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666788352:192.168.201.31@tcp:104: 00000100:00080000:2.0:1789135965.215426:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135965.215679:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789135965.218762:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.218909:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666788352:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135965.218949:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.219639:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644662016 00000100:00100000:1.0:1789135965.219650:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644662016 00000100:00100000:1.0:1789135965.219926:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1789135965.219945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+44:6165:x1876044644662016:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789135965.222048:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+45:6165:x1876044644662016:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 2103us (3288us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789135965.222061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1789135965.225776:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135965.233479:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644662144 00000100:00100000:0.0:1789135965.233499:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644662144 00010000:00010000:0.0:1789135965.233582:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 45 pid: 6515 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135965.233632:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:0.0:1789135965.233643:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+45:2391:x1876044644662144:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135965.233664:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135965.233673:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 45 pid: 6515 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.233689:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 45 pid: 6515 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.233718:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2ee6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089a7 expref: 45 pid: 6515 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.233739:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135965.233763:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.233774:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.233783:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.233822:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135965.233930:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+44:2391:x1876044644662144:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 289us (8169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135965.233938:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00010000:00010000:3.0:1789135965.234448:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234470:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135965.234537:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789135965.234541:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135965.234601:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234616:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234627:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234635:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234643:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234649:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.234654:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234662:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234674:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135965.234677:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.234682:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234697:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234710:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234716:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234723:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234728:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.234731:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234737:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234744:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:3.0:1789135965.234746:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.234748:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234753:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234788:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089b5 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234801:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089b5 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.234813:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135965.234815:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135965.234817:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caea00, rc 0) 00000100:00100000:3.0:1789135965.234890:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+43:11484:x1876044644661760:12345-192.168.201.31@tcp:101:stat.0 Request processed in 20353us (20744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.234898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:0.0:1789135965.321202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.321294:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644662400 00000100:00100000:3.0:1789135965.321309:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644662400 00000100:00100000:3.0:1789135965.321402:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:3.0:1789135965.321415:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+43:11490:x1876044644662400:12345-192.168.201.31@tcp:36:truncate.0 00010000:00010000:3.0:1789135965.321503:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135965.321542:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089b5 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.321565:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135965.321571:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135965.321797:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.321813:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.321825:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135965.322063:0:14529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1789135965.322090:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000058bb59b7 reply state 0000000087112f85 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.322134:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.322141:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135965.322144:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135965.322148:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135965.322783:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+45:11490:x1876044644662400:12345-192.168.201.31@tcp:36:truncate.0 Request processed in 1364us (1592us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789135965.322794:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000020:00080000:3.0:1789135965.322802:0:14529:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789135965.416534:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135965.480954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135965.481262:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644662528 00000100:00100000:2.0:1789135965.481277:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644662528 00000100:00100000:0.0:1789135965.481453:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:0.0:1789135965.481468:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+45:11504:x1876044644662528:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:0.0:1789135965.481501:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135965.481530:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089bc expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482084:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482107:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482133:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482146:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482169:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482177:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482260:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482269:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482276:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135965.482321:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789135965.482326:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135965.482349:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482361:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482370:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482376:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482384:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.482401:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135965.482406:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483741:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483767:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135965.483770:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135965.483776:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483783:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483802:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483809:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483815:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483820:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135965.483823:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483829:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483899:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:0.0:1789135965.483903:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135965.483907:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483913:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de2f3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483954:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 47 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483974:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 46 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.483983:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135965.483985:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135965.483987:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:0.0:1789135965.484064:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+46:11504:x1876044644662528:12345-192.168.201.31@tcp:101:stat.0 Request processed in 2599us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135965.484073:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:3.0:1789135965.568975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135965.569216:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644662784 00000100:00100000:0.0:1789135965.569229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644662784 00000100:00100000:0.0:1789135965.569307:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:0.0:1789135965.569320:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+46:11514:x1876044644662784:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135965.569357:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135965.569386:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135965.569578:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789135965.569721:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089c3 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.569740:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:0.0:1789135965.569744:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135965.569750:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089c3 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.569770:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031600, rc 0) 00000100:00100000:0.0:1789135965.570367:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+47:11514:x1876044644662784:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1045us (1405us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1789135965.570377:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:1.0:1789135965.575463:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.576030:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644663040 00000100:00100000:3.0:1789135965.576044:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644663040 00000100:00100000:3.0:1789135965.576132:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1789135965.576144:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+47:11514:x1876044644663040:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135965.576477:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+48:11514:x1876044644663040:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 335us (1028us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789135965.576487:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:1.0:1789135965.652461:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135965.652917:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644663296 00000100:00100000:2.0:1789135965.652934:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644663296 00000100:00100000:2.0:1789135965.653023:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1789135965.653036:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+48:11520:x1876044644663296:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135965.653072:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135965.653101:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2f56 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089ca expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.653253:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.653273:0:14528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 49 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.653310:0:14528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.653362:0:14528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 49 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.653379:0:14528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 49 pid: 8299 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.653398:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86ded00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666788480:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135965.653531:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789135965.657307:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86ded00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666788480:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135965.657363:0:14528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.657699:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135965.657789:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644663424 00000100:00100000:0.0:1789135965.657798:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644663424 00010000:00010000:0.0:1789135965.657847:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 50 pid: 8299 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.658526:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:2.0:1789135965.658543:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+50:2392:x1876044644663424:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135965.658567:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135965.658576:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 50 pid: 8299 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.658590:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 50 pid: 8299 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.658618:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de2f41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089bc expref: 50 pid: 8299 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.658660:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:2.0:1789135965.658666:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.658677:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.658685:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.658726:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135965.658910:0:14528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.658919:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135965.658943:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789135965.659137:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de2f56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 51 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.659155:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 50 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.659162:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135965.659165:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135965.659168:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5200, rc 0) 00000100:00100000:2.0:1789135965.659253:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+50:2392:x1876044644663424:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 715us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135965.659262:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:1.0:1789135965.662277:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+49:11520:x1876044644663296:12345-192.168.201.31@tcp:101:bash.0 Request processed in 9225us (9815us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789135965.662324:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:0.0:1789135965.669721:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135965.670838:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644663680 00000100:00100000:2.0:1789135965.674801:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644663680 00000100:00100000:2.0:1789135965.675735:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:2.0:1789135965.675751:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+49:11520:x1876044644663680:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:2.0:1789135965.676246:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.676270:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.676284:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135965.676455:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789135965.676482:0:6517:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a8eb1e4a reply state 0000000019e18493 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.676517:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.676526:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:2.0:1789135965.676529:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789135965.676534:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135965.677529:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+52:11520:x1876044644663680:12345-192.168.201.31@tcp:36:bash.0 Request processed in 1775us (7817us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789135965.677542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000020:00080000:2.0:1789135965.677550:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789135965.682794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.682845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135965.682883:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644663808 00000100:00100000:3.0:1789135965.682908:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135965.683067:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644663808 00000100:00100000:2.0:1789135965.683226:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644663936 00000100:00100000:2.0:1789135965.683232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644663936 00000100:00100000:3.0:1789135965.683277:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135965.683306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644664192 00000100:00100000:2.0:1789135965.683311:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644664192 00000100:00100000:2.0:1789135965.683375:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 361 00000100:00100000:3.0:1789135965.683391:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 362 00000100:00100000:2.0:1789135965.683394:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644663936:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135965.683419:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644664192:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135965.683514:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644663936:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 124us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.683524:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644664192:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 111us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135965.683535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 361 00000100:00100000:3.0:1789135965.683571:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 362 00000100:00080000:2.0:1789135965.683571:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789135965.683579:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135965.683625:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644664064 00000100:00100000:3.0:1789135965.683634:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644664064 00000100:00100000:2.0:1789135965.683634:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.683712:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:3.0:1789135965.683720:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2389:x1876044644664064:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135965.683756:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2389:x1876044644664064:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.683762:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:3.0:1789135965.683791:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644664320 00000100:00100000:3.0:1789135965.683795:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644664320 00000100:00080000:2.0:1789135965.683816:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789135965.683823:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135965.683840:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 363 00000100:00100000:3.0:1789135965.683848:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644664320:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135965.683933:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644664320:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.683942:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 363 00000100:00100000:1.0:1789135965.686821:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 457 00000100:00100000:1.0:1789135965.686848:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644663808:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135965.687000:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644663808:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 165us (4223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135965.687009:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 457 00000100:00100000:2.0:1789135965.688957:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135965.689091:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644664448 00000100:00100000:0.0:1789135965.689102:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644664448 00000100:00100000:0.0:1789135965.689229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1789135965.689241:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+52:11520:x1876044644664448:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135965.689270:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135965.689299:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.689470:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.689489:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 53 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.689500:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.689547:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 53 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.689563:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 53 pid: 14528 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135965.689580:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4498b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666788608:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135965.689693:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2481900 going to sleep for 11 seconds 00000100:00100000:0.0:1789135965.699247:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.701226:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644664576 00000100:00100000:3.0:1789135965.701246:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644664576 00010000:00010000:3.0:1789135965.701316:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 54 pid: 14528 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.701384:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:3.0:1789135965.701397:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4499680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+54:2391:x1876044644664576:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135965.701417:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135965.701437:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 54 pid: 14528 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.701482:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 54 pid: 14528 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.701516:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135965.701522:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.701536:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.701545:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.701571:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135965.701663:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4499680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+54:2391:x1876044644664576:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 269us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.701672:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00010000:00010000:2.0:1789135965.705208:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f5d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ca expref: 53 pid: 14528 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135965.705270:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4498b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666788608:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135965.705301:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.705314:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.705320:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135965.705409:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789135965.705415:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135965.705443:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.705492:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de2f72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089d1 expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.705512:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089d1 expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.705523:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:2.0:1789135965.705526:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135965.705530:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031a00, rc 0) 00000100:00100000:2.0:1789135965.705631:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+52:11520:x1876044644664448:12345-192.168.201.31@tcp:101:bash.0 Request processed in 16392us (16685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135965.705646:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1789135965.708584:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.708937:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644664832 00000100:00100000:3.0:1789135965.708951:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644664832 00000100:00100000:3.0:1789135965.709029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789135965.709040:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+52:11520:x1876044644664832:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:3.0:1789135965.709371:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+53:11520:x1876044644664832:12345-192.168.201.31@tcp:35:bash.0 Request processed in 332us (805us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789135965.709381:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:1.0:1789135965.777409:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135965.777696:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644665088 00000100:00100000:2.0:1789135965.777710:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644665088 00000100:00100000:2.0:1789135965.777840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:2.0:1789135965.777965:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+53:11530:x1876044644665088:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135965.778002:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135965.778031:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135965.778330:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789135965.778474:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089d8 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.778492:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:2.0:1789135965.778495:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135965.778502:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de2f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089d8 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135965.778519:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5200, rc 0) 00000100:00100000:2.0:1789135965.778657:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11530:x1876044644665088:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 806us (1266us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789135965.778667:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:2.0:1789135965.782173:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.782324:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644665216 00000100:00100000:3.0:1789135965.782336:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644665216 00000100:00100000:3.0:1789135965.782416:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:3.0:1789135965.782449:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11530:x1876044644665216:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:3.0:1789135965.782550:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782572:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782586:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782599:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782607:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782614:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782700:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782708:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782713:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135965.782765:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782776:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782788:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782794:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782797:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.782801:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782806:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782817:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135965.782820:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.782825:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782829:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2f8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782840:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782844:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782847:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782851:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.782897:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782902:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782907:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:3.0:1789135965.782909:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.782911:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782915:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2f95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782922:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782926:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782932:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782938:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.782941:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782946:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782952:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135965.782954:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.782963:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.782970:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2f9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135965.783054:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11530:x1876044644665216:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 608us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.783062:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:0.0:1789135965.787692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.787806:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644665472 00000100:00100000:3.0:1789135965.787820:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644665472 00000100:00100000:3.0:1789135965.788149:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:3.0:1789135965.788163:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11530:x1876044644665472:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135965.788780:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+55:11530:x1876044644665472:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 617us (1103us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789135965.788790:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789135965.824417:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.824576:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644665728 00000100:00100000:3.0:1789135965.824590:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644665728 00000100:00100000:3.0:1789135965.824672:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:3.0:1789135965.824685:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+55:11533:x1876044644665728:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135965.824721:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135965.824750:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2fa3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089df expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.824900:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.824921:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.824959:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.824975:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.824982:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.824990:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825144:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825154:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825162:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135965.825175:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789135965.825281:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825289:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825296:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825303:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.825315:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825325:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825600:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135965.825605:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.825611:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825620:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de2faa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825636:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825643:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825649:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825654:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135965.825657:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825662:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825670:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:3.0:1789135965.825672:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135965.825682:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.825687:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.826278:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de2fa3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089df expref: 58 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.826301:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089df expref: 57 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135965.826310:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135965.826321:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135965.826325:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:0.0:1789135965.827809:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+57:11533:x1876044644665728:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 3113us (3396us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789135965.827823:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:2.0:1789135965.833100:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135965.833282:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135965.833368:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644665984 00000100:00100000:3.0:1789135965.833381:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644665984 00000100:00100000:3.0:1789135965.833475:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1789135965.833490:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+57:2392:x1876044644665984:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135965.833509:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135965.833546:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089df expref: 57 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135965.833580:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135965.833586:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135965.833658:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+56:2392:x1876044644665984:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 170us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135965.833666:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1789135965.838676:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644665856 00000100:00100000:1.0:1789135965.838697:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644665856 00000100:00100000:1.0:1789135965.838844:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:1.0:1789135965.838869:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+56:11533:x1876044644665856:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:1.0:1789135965.838988:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839013:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839027:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839075:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839082:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839125:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839132:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135965.839137:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839146:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839161:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135965.839166:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135965.839172:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135965.839178:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de2fc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135965.839641:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+56:11533:x1876044644665856:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 782us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135965.839651:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:2.0:1789135965.843315:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135965.843498:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644666240 00000100:00100000:0.0:1789135965.843511:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644666240 00000100:00100000:0.0:1789135965.843587:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1789135965.843598:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+56:11533:x1876044644666240:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135965.843911:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+57:11533:x1876044644666240:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 314us (611us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789135965.843920:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:2.0:1789135966.052338:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.053967:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644666496 00000100:00100000:3.0:1789135966.053984:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644666496 00000100:00100000:3.0:1789135966.054069:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:3.0:1789135966.054078:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+57:11551:x1876044644666496:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:3.0:1789135966.054119:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135966.054153:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089e6 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.054306:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.054352:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.054369:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135966.054385:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789135966.064548:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de2fcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089e6 expref: 60 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.064586:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089e6 expref: 59 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.064598:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135966.064601:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789135966.064605:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caea00, rc 0) 00000100:00100000:3.0:1789135966.064708:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+59:11551:x1876044644666496:12345-192.168.201.31@tcp:101:cat.0 Request processed in 10629us (12384us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789135966.064719:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 74 00000001:00080000:0.0:1789135966.090657:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:0.0:1789135966.090723:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789135966.090787:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7c12ed540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789135966.090793:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7f6864e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7c12ed780 00000020:00080000:0.0:1789135966.090796:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7f6864a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c3a30a00 00000020:00080000:3.0:1789135966.091554:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789135966.091777:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789135966.092782:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789135966.092806:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666788736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135966.092920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135966.093009:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666788736 00000100:00100000:3.0:1789135966.093016:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666788736 00000100:00100000:3.0:1789135966.093069:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789135966.093079:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666788736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789135966.093129:0:8430:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1789135966.093165:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa40c5b, atime: 0x6aa40c5b, ctime: 0x6aa40c5b, blocks: 0x8 00010000:00010000:3.0:1789135966.093173:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093189:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789135966.093193:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135966.093199:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093216:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093226:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093233:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093251:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135966.093775:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666788736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 695us (853us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789135966.093790:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789135966.093822:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789135966.093832:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135966.093838:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093881:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135966.093885:0:13980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093894:0:13980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093912:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093920:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de2fe2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.093941:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135966.093943:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135966.093945:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789135966.094136:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7c86dc780/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789135966.094143:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666788736:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789135966.099143:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099169:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099177:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099205:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.099210:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099220:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099252:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135966.099256:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.099261:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099267:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de2db2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099289:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099295:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099300:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099305:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.099308:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099314:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099757:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135966.099763:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.099768:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099775:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de2db9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099796:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099803:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099809:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099813:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.099816:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099822:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099831:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7f00) 00010000:00010000:1.0:1789135966.099833:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.099836:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.099842:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de2df8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100621:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100629:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100635:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100641:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.100646:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100652:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100663:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135966.100666:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.100669:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100675:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de2f02 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100688:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100700:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100706:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100722:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.100727:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100734:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100743:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135966.100757:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.100761:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100768:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de2f25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100780:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100788:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100794:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100798:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.100800:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100805:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100823:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135966.100825:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.100828:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.100833:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de2f6b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.102805:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.102901:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644666624 00000100:00100000:2.0:1789135966.102912:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644666624 00000100:00100000:2.0:1789135966.103002:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:2.0:1789135966.103011:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4499680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11552:x1876044644666624:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135966.103035:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135966.103055:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089ed expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.103131:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de2ff0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.103145:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de2ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.103165:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de2ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135966.103208:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789135966.103211:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135966.103230:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de2ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.103255:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ed expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.103274:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de2ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ed expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.103283:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:2.0:1789135966.103285:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135966.103288:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4000, rc 0) 00000100:00100000:2.0:1789135966.103366:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4499680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11552:x1876044644666624:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 355us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135966.103379:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:3.0:1789135966.107831:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135966.108433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667008 00000100:00100000:1.0:1789135966.108449:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667008 00000100:00100000:1.0:1789135966.108519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:1.0:1789135966.108530:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11552:x1876044644667008:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135966.108836:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11552:x1876044644667008:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 307us (1021us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789135966.108845:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:3.0:1789135966.117422:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.117591:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667136 00000100:00100000:0.0:1789135966.117606:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667136 00000100:00100000:0.0:1789135966.117699:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1789135966.117713:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11552:x1876044644667136:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:0.0:1789135966.117736:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789135966.117769:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2f79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089d1 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.117820:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de2fd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089e6 expref: 14 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.117830:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de2e76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0898b expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.117839:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135966.117843:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135966.117984:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+12:11552:x1876044644667136:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 273us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.117991:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:3.0:1789135966.121038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.121267:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667264 00000100:00100000:2.0:1789135966.121282:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667264 00000100:00100000:2.0:1789135966.121597:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:2.0:1789135966.121608:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+12:11552:x1876044644667264:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:2.0:1789135966.121760:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.121778:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.121789:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135966.122093:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789135966.122978:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789135966.123146:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789135966.123292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+12:11552:x1876044644667264:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 1679us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.123315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:1.0:1789135966.161500:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.161598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667392 00000100:00100000:0.0:1789135966.161616:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667392 00000100:00100000:0.0:1789135966.161936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:0.0:1789135966.161951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+12:11554:x1876044644667392:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135966.161982:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135966.162012:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ffe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162122:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162142:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162157:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162197:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162205:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162211:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162329:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162347:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162355:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135966.162417:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789135966.162436:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135966.162464:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162479:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162488:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162495:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162514:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162520:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135966.162525:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162534:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162549:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135966.162553:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135966.162558:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162566:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de3005 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162583:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162589:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162594:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162600:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135966.162604:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162620:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162630:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1000) 00010000:00010000:0.0:1789135966.162632:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135966.162635:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162642:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de300c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162694:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031a00/0x559c8745c6de2ffe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162709:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.162717:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135966.162719:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135966.162722:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:0.0:1789135966.162943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11554:x1876044644667392:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 993us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.162952:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00010000:00010000:1.0:1789135966.440191:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789135966.511920:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135966.511930:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135966.511973:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789135966.511982:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135966.512134:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66883c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666788864:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135966.512246:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135966.528612:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66883c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666788864:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135966.534641:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.537203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667520 00000100:00100000:2.0:1789135966.537222:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667520 00000100:00100000:2.0:1789135966.537349:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:2.0:1789135966.537361:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11565:x1876044644667520:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789135966.537396:0:6515:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789135966.537556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11565:x1876044644667520:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 196us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135966.537564:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:3.0:1789135966.548506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135966.550163:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667648 00000100:00100000:1.0:1789135966.550198:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667648 00000100:00100000:1.0:1789135966.550282:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:1.0:1789135966.550293:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11565:x1876044644667648:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789135966.550372:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550390:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550403:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550445:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550453:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550460:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550487:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550496:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550502:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135966.550547:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789135966.550552:0:14528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135966.550572:0:14528:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550585:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550590:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550598:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550604:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.550608:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550616:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550628:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:1.0:1789135966.550631:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.550636:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550643:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de301a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550657:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550663:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550670:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550681:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.550685:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550691:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550699:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135966.550702:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.550705:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550711:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3021 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550728:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550734:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550739:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550745:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.550748:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550753:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550773:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135966.550775:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.550779:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.550785:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3028 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135966.550903:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11565:x1876044644667648:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 611us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135966.551200:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:0.0:1789135966.554355:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.555061:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644667904 00000100:00100000:3.0:1789135966.555071:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644667904 00000100:00100000:3.0:1789135966.555142:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:3.0:1789135966.555153:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+13:11565:x1876044644667904:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135966.555174:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135966.555195:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de302f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab089fb expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555405:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555422:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555434:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135966.555447:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789135966.555535:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555542:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555549:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555555:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135966.555574:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555582:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555596:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135966.555599:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135966.555605:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555611:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555653:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de302f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089fb expref: 15 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555663:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:3.0:1789135966.555666:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135966.555670:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de302f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089fb expref: 15 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.555679:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:3.0:1789135966.555753:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644667904:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 602us (1409us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1789135966.555760:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:0.0:1789135966.561643:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.562487:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644668032 00000100:00100000:3.0:1789135966.562499:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644668032 00000100:00100000:3.0:1789135966.562563:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:3.0:1789135966.562574:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644668032:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135966.562617:0:14529:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135966.562749:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644668032:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 176us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.562756:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:2.0:1789135966.576771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135966.576890:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644668288 00000100:00100000:1.0:1789135966.576902:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644668288 00000100:00100000:1.0:1789135966.576975:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:1.0:1789135966.576986:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644668288:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135966.577011:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135966.577015:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135966.577044:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de2ff0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ed expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.577065:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135966.577071:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135966.577084:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3044 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a02 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135966.577478:0:14528:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789135966.577608:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de304b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.577634:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de304b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.577645:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de304b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.577699:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3044 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a02 expref: 16 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.577715:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de304b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a02 expref: 15 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.577722:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135966.577725:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135966.577728:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135966.577782:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11565:x1876044644668288:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 797us (1022us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789135966.577790:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:2.0:1789135966.583311:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.583481:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644668544 00000100:00100000:3.0:1789135966.583491:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644668544 00000100:00100000:3.0:1789135966.583594:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:3.0:1789135966.583605:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11565:x1876044644668544:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135966.583660:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135966.583686:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de304b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a02 expref: 15 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583706:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a6c2b0f000) 00010000:00010000:3.0:1789135966.583716:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135966.583741:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583755:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583765:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583778:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583785:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583810:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583889:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583896:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583902:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583922:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135966.583927:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583934:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583943:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135966.583946:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135966.583949:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583956:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3059 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583965:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583971:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583984:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583989:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135966.583992:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.583998:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.584007:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe7774078 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135966.584009:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135966.584012:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.584018:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3060 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe7774078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135966.584231:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644668544:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 626us (930us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135966.584238:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:0.0:1789135966.602028:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.602103:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644668672 00000100:00100000:3.0:1789135966.602112:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644668672 00000100:00100000:3.0:1789135966.602177:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:3.0:1789135966.602187:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644668672:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135966.602207:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135966.602229:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3067 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a09 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.602284:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.602298:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.602310:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.602488:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3067 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 16 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.602503:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 15 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.602511:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135966.602514:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135966.602518:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:3.0:1789135966.602573:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11565:x1876044644668672:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 387us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.602580:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:1.0:1789135966.616783:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.617035:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644668928 00000100:00100000:2.0:1789135966.617138:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644668928 00000100:00100000:2.0:1789135966.617202:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:2.0:1789135966.617228:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11565:x1876044644668928:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789135966.617417:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.617442:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.617455:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135966.617613:0:14528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789135966.617621:0:14528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414736766157ns, next at 415736764061ns, rc = 0 00000004:00010000:2.0:1789135966.617665:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000eeaf1300 reply state 00000000f9ebf5eb transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.617678:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.617685:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:2.0:1789135966.617688:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789135966.617692:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789135966.617839:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+17:11565:x1876044644668928:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 613us (1065us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789135966.617847:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:3.0:1789135966.633692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.633832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644669056 00000100:00100000:2.0:1789135966.633842:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644669056 00000100:00100000:2.0:1789135966.633932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:2.0:1789135966.633943:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+17:11565:x1876044644669056:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135966.633967:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135966.634003:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a10 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.634059:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.634074:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.634102:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:2.0:1789135966.634105:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135966.634110:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5e00, rc 0) 00000100:00100000:2.0:1789135966.634166:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:11565:x1876044644669056:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 225us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135966.634173:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:3.0:1789135966.637673:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.637767:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644669184 00000100:00100000:2.0:1789135966.637778:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644669184 00000100:00100000:2.0:1789135966.637831:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789135966.637840:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1876044644669184:12345-192.168.201.31@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789135966.637910:0:8432:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:2.0:1789135966.637943:0:8432:0:(genops.c:1385:class_connect()) connect: client 50163b70-8f7a-42d3-bcbf-652648370aa8, cookie 0x559c8745c6de3083 00002000:00100000:2.0:1789135966.637958:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 50163b70-8f7a-42d3-bcbf-652648370aa8/ffff90a6c44fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789135966.637976:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789135966.638050:0:8432:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789135966.638082:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a7d893c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789135966.638158:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2388:x1876044644669184:12345-192.168.201.31@tcp:8:lhsmtool_posix.0 Request processed in 318us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135966.638180:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789135966.654762:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.654882:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644669312 00000100:00100000:3.0:1789135966.654893:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644669312 00000100:00100000:3.0:1789135966.654968:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:3.0:1789135966.654979:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:0:x1876044644669312:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789135966.655889:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789135966.660629:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1789135966.660645:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000100:00100000:0.0:1789135966.660920:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:0:x1876044644669312:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 5935us (6159us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789135966.660948:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:2.0:1789135966.690369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.690618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644669568 00000100:00100000:3.0:1789135966.690629:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644669568 00000100:00100000:3.0:1789135966.690694:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1789135966.690705:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+18:11565:x1876044644669568:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135966.690966:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11565:x1876044644669568:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 263us (607us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789135966.690974:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:0.0:1789135966.718671:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.718710:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644669824 00000100:00100000:0.0:1789135966.718720:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644669824 00000100:00100000:0.0:1789135966.718780:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:0.0:1789135966.718791:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11565:x1876044644669824:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135966.718934:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11565:x1876044644669824:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 144us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.718942:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:1.0:1789135966.754582:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.757711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644669952 00000100:00100000:3.0:1789135966.757726:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644669952 00000100:00100000:3.0:1789135966.757791:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:3.0:1789135966.757802:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11565:x1876044644669952:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135966.757822:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135966.757844:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de308a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.759672:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3091 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.759693:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3091 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.759705:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3091 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135966.759753:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135966.759782:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3091 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.759813:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de308a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a17 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.759832:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3091 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a17 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.759840:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135966.759843:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789135966.759847:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae400, rc 0) 00000100:00100000:3.0:1789135966.760032:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11565:x1876044644669952:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2231us (5457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.760042:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:3.0:1789135966.774181:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.774217:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670080 00000100:00100000:3.0:1789135966.774225:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670080 00000100:00100000:3.0:1789135966.774275:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1789135966.774286:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644670080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135966.774304:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135966.774326:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a1e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135966.774352:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c5e, blocks: 0x0 00010000:00010000:3.0:1789135966.774371:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1789135966.774375:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135966.774384:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.774428:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.774441:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caec00, rc 0) 00000100:00100000:3.0:1789135966.774496:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644670080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 213us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.774502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1789135966.804082:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.804508:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670336 00000100:00100000:0.0:1789135966.804519:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670336 00000100:00100000:0.0:1789135966.804583:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:0.0:1789135966.804593:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11565:x1876044644670336:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135966.804702:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11565:x1876044644670336:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 110us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.804710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:3.0:1789135966.819654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.822564:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670464 00000100:00100000:0.0:1789135966.822579:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670464 00000100:00100000:0.0:1789135966.822678:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:0.0:1789135966.822688:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:11565:x1876044644670464:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135966.822707:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135966.822728:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a25 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.822761:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.822778:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135966.822783:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135966.822789:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.822823:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.822836:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.822850:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1876044666788992:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135966.822986:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135966.826734:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1876044666788992:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135966.826770:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.826803:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031a00, rc 0) 00000100:00100000:0.0:1789135966.826885:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11565:x1876044644670464:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 4197us (7241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.826896:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:3.0:1789135966.828235:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.828331:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670592 00000100:00100000:0.0:1789135966.828339:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670592 00010000:00010000:0.0:1789135966.828378:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.828442:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:0.0:1789135966.828452:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644670592:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135966.828467:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135966.828489:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.828503:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.828528:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3098 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a1e expref: 7 pid: 8432 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.832480:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135966.832491:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135966.832511:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.832526:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.832586:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.832603:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1876044666789120:192.168.201.31@tcp:105: 00000100:00100000:0.0:1789135966.832730:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135966.839509:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1876044666789120:192.168.201.31@tcp:105: 00010000:00010000:3.0:1789135966.839539:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135966.839604:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644670592:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 11152us (11374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.839615:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:3.0:1789135966.841369:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.841500:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670720 00000100:00100000:0.0:1789135966.841509:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670720 00002000:00100000:0.0:1789135966.841559:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90a6c3ff70c0 x1876044644670720/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:397/0 lens 504/0 e 0 to 0 dl 1789135977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135966.841572:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c3ff70c0 with x1876044644670720 ext(0->8) 00002000:00010000:0.0:1789135966.841578:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c3ff70c0 00000100:00100000:0.0:1789135966.841615:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1789135966.841626:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644670720:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789135966.843753:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644670720:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 2119us (2383us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789135966.843768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00002000:00100000:0.0:1789135966.843781:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90a6c3ff70c0 x1876044644670720/t4294967303(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:397/0 lens 504/448 e 0 to 0 dl 1789135977 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135966.843790:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c3ff70c0 with x1876044644670720 ext(0->8) 00002000:00010000:0.0:1789135966.843797:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c3ff70c0 00000100:00100000:0.0:1789135966.859301:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.859712:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670848 00000100:00100000:3.0:1789135966.859722:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670848 00000100:00100000:3.0:1789135966.859787:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:3.0:1789135966.859797:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11565:x1876044644670848:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789135966.862307:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00010000:00010000:0.0:1789135966.862481:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.862498:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.862532:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.862539:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135966.862555:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.862563:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.862581:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135966.862585:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135966.862590:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.862596:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3075 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135966.862791:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:3.0:1789135966.863694:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f668a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666789248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789135966.863774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135966.863886:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666789248 00000100:00100000:0.0:1789135966.863894:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666789248 00000100:00100000:0.0:1789135966.863955:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789135966.863964:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666789248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789135966.864109:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789135966.864113:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789135966 00002000:00010000:0.0:1789135966.864115:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789135966.864117:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789135966 -> 1789135966 00002000:00010000:0.0:1789135966.864119:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:2.0:1789135966.864212:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00080000:1.0:1789135966.864754:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135966.864800:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666789248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 835us (1023us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789135966.864810:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00080000:2.0:1789135966.864940:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789135966.864953:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1789135966.865157:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7f668a580/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789135966.865181:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f668a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666789248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789135966.865444:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644670848:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 5646us (6150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.865453:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:3.0:1789135966.867493:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.867563:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644670976 00000100:00100000:0.0:1789135966.867572:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644670976 00000100:00100000:0.0:1789135966.867657:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:0.0:1789135966.867667:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644670976:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789135966.869693:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1789135966.869707:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1789135966.869901:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644670976:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 2230us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.869911:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:2.0:1789135966.874791:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.874900:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644671232 00000100:00100000:0.0:1789135966.874910:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644671232 00000100:00100000:0.0:1789135966.874977:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:0.0:1789135966.874987:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644671232:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135966.875217:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135966.875244:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3091 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a17 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.875263:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135966.875268:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135966.875299:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.875315:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.875334:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135966.875618:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000044b6c4f0 reply state 00000000bd1b7eda transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.875631:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.875638:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135966.875654:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135966.875657:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135966.875769:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11565:x1876044644671232:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 782us (988us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789135966.875776:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:3.0:1789135966.881499:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.881584:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644671360 00000100:00100000:0.0:1789135966.881595:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644671360 00000100:00100000:0.0:1789135966.881658:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1789135966.881668:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644671360:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789135966.881837:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789135966.881841:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789135966 -> 1789135965 00002000:00010000:0.0:1789135966.881844:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789135963 00002000:00010000:0.0:1789135966.881846:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789135966 -> 1789135965 00002000:00010000:0.0:1789135966.881849:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789135966.881966:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644671360:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 298us (477us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789135966.881974:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:1.0:1789135966.886073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.886243:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644671616 00000100:00100000:0.0:1789135966.886254:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644671616 00000100:00100000:0.0:1789135966.886314:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:0.0:1789135966.886332:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11565:x1876044644671616:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789135966.886555:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.886573:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 15 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.886593:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.886627:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 15 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.886640:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 15 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.886654:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbe1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666789376:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135966.886825:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135966.893268:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.893413:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbe1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666789376:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135966.893452:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135966.893898:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644671744 00000100:00100000:1.0:1789135966.893906:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644671744 00010000:00010000:1.0:1789135966.893952:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 16 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135966.893989:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:1.0:1789135966.894014:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+16:2391:x1876044644671744:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135966.894028:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135966.894046:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 16 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.894059:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 16 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.894082:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de306e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a09 expref: 16 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.894109:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135966.894114:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.894126:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.894134:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.894165:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135966.894218:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+15:2391:x1876044644671744:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 205us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135966.894225:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00010000:00010000:2.0:1789135966.894359:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894367:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894405:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894413:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894420:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894438:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135966.894442:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894460:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894471:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:2.0:1789135966.894474:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789135966.894477:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.894483:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135966.894524:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644671616:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 8202us (8462us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789135966.894533:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:0.0:1789135966.906727:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135966.906794:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644671872 00000100:00100000:2.0:1789135966.906803:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644671872 00000100:00100000:2.0:1789135966.906881:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:2.0:1789135966.906891:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644671872:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789135966.906932:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.906952:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.906962:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789135966.906966:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135966.906971:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.907025:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.907050:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 7 pid: 8429 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135966.907065:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1876044666789504:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135966.907157:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135966.910444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.910589:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644672000 00000100:00100000:0.0:1789135966.910599:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644672000 00010000:00010000:0.0:1789135966.910644:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 8 pid: 8429 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.910676:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:0.0:1789135966.910685:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644672000:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135966.910699:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135966.910721:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 8 pid: 8429 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.910750:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 8 pid: 8429 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.910778:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135966.910782:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135966.910789:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.910798:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.910818:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135966.910896:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644672000:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 211us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.910904:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00010000:00010000:2.0:1789135966.911462:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad943bb5/0x559c8745c6de309f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a25 expref: 7 pid: 8429 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135966.911478:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8429:1876044666789504:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135966.911501:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911511:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911517:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911539:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911560:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911567:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911574:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135966.911577:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911585:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911601:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.911608:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e24021/0x559c8745c6de30b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135966.911666:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644671872:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 4776us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135966.911675:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1789135966.915506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.915698:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644672256 00000100:00100000:0.0:1789135966.915708:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644672256 00000100:00100000:0.0:1789135966.915757:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:0.0:1789135966.915766:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11565:x1876044644672256:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789135966.915849:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.916298:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 14 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.916308:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.917194:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 14 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.917210:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 14 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.917226:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666789632:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135966.917318:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135966.923689:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666789632:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135966.923722:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135966.924814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135966.926330:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644672384 00000100:00100000:0.0:1789135966.926343:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644672384 00010000:00010000:0.0:1789135966.926389:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 15 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.926446:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:0.0:1789135966.926457:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+15:2391:x1876044644672384:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135966.926472:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135966.926479:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 15 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926492:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 15 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926529:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de2efb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089ae expref: 15 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926546:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789135966.926551:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926561:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926569:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926593:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135966.926650:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e82940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2391:x1876044644672384:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 195us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.926658:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 74 00010000:00010000:0.0:1789135966.926703:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926710:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926921:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926934:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926952:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926984:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135966.926997:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 14 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135966.927010:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666789760:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135966.927096:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc840 going to sleep for 11 seconds 00000100:00100000:3.0:1789135966.931597:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666789760:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135966.931629:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135966.938833:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135966.939510:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644672512 00000100:00100000:1.0:1789135966.939520:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644672512 00010000:00010000:1.0:1789135966.939565:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 15 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135966.939628:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:1.0:1789135966.939639:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+15:2392:x1876044644672512:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135966.939654:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135966.939661:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 15 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.939674:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 15 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.939698:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de307c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a10 expref: 15 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.939715:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135966.939721:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.939730:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.939737:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.941157:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135966.941226:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44ca940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2392:x1876044644672512:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 1584us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135966.941237:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 75 00010000:00010000:2.0:1789135966.944592:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135966.944620:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135966.944734:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789135966.944846:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789135966.944917:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789135966.945004:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666789888:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789135966.945073:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135966.945118:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135966.947056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666789888 00000100:00100000:0.0:1789135966.947074:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666789888 00000100:00100000:0.0:1789135966.947154:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789135966.947165:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1876044666789888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789135966.947300:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1876044666789888:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135966.947308:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789135966.947523:0:6515:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789135966.947531:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7f668a580, transno 4294967304 00000100:00100000:2.0:1789135966.947556:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666789888:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789135966.947723:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789135966.947791:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666790016:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789135966.947830:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135966.947889:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135966.948533:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666790016 00000100:00100000:0.0:1789135966.948540:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666790016 00000100:00100000:0.0:1789135966.948589:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789135966.948598:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1876044666790016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789135966.949467:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1876044666790016:12345-0@lo:1000:mdt00_000.0 Request processed in 866us (1632us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789135966.949478:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789135966.954202:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666790016:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789135966.954267:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954277:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954284:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954290:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135966.954295:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954314:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954406:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:3.0:1789135966.954410:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135966.954415:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954423:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031600/0x559c8745c6de30c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954458:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954465:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954471:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954476:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135966.954479:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954485:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954492:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135966.954494:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135966.954497:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.954514:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de2ff7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.956170:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.956195:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.956204:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.956247:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.956266:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 17 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135966.956282:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666790144:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135966.956383:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135966.966886:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666790144:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135966.966919:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135966.997455:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135966.997615:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644672640 00000100:00100000:3.0:1789135966.997625:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644672640 00010000:00010000:3.0:1789135966.997749:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 18 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135966.997837:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:3.0:1789135966.997848:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+18:2392:x1876044644672640:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135966.998067:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135966.998077:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 18 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.998100:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 18 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.998123:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030800/0x559c8745c6de3013 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab089f4 expref: 18 pid: 6516 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.998136:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789135966.998142:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.998152:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.998160:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135966.998189:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135966.998240:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+17:2392:x1876044644672640:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 394us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135966.998248:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 76 00010000:00010000:1.0:1789135966.998355:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998363:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998376:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998382:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998389:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998394:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.998399:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998406:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998416:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135966.998419:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135966.998422:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998428:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de30c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998439:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998454:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998460:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998466:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135966.998469:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998475:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998483:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789135966.998486:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135966.998489:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135966.998495:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030400/0x559c8745c6de30bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135966.998628:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11565:x1876044644672256:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 82862us (83132us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789135966.998932:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 93 00000020:00080000:1.0:1789135966.998935:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789135966.999024:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135966.999029:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135966.999043:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789135966.999049:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135967.009470:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.010359:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644672896 00000100:00100000:3.0:1789135967.010376:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644672896 00000100:00100000:3.0:1789135967.010448:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789135967.010457:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11565:x1876044644672896:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789135967.010922:0:6518:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789135967.011007:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789135967.011042:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.011059:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.011070:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.011079:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.011096:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.011103:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.011121:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135967.011212:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+18:11565:x1876044644672896:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 754us (1751us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789135967.011220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000020:00080000:3.0:1789135967.011225:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1789135967.011527:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789135967.011966:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135967.011975:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.011983:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135967.011987:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.011995:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.012010:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135967.012013:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789135967.012017:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.012023:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de30d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.012033:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135967.012035:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135967.012037:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135967.099454:0:14922:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135967.099465:0:14922:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135967.099487:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789135967.099496:0:14922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789135967.283212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135967.283296:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644673152 00000100:00100000:1.0:1789135967.283306:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644673152 00000100:00100000:1.0:1789135967.283378:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:1.0:1789135967.283389:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+18:11575:x1876044644673152:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135967.283416:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135967.283441:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de30d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a2c expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.283552:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de30de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.283567:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de30de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.283578:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de30de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135967.283589:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789135967.283708:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de30d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a2c expref: 21 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.283730:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de30de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a2c expref: 20 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.283739:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135967.283742:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135967.283746:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879a00, rc 0) 00000100:00100000:1.0:1789135967.283814:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11575:x1876044644673152:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 427us (614us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789135967.283838:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:3.0:1789135967.293776:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135967.293957:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644673280 00000100:00100000:1.0:1789135967.293969:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644673280 00000100:00100000:1.0:1789135967.294030:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:1.0:1789135967.294041:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11575:x1876044644673280:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:1.0:1789135967.294132:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294149:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294162:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294179:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294187:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294193:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294292:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294300:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294307:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135967.294385:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294400:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294407:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294414:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294419:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135967.294422:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294429:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294441:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135967.294444:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.294449:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294456:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de30ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294471:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294476:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294489:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294493:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135967.294496:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294502:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294510:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a6c2b0f200) 00010000:00010000:1.0:1789135967.294512:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.294515:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294521:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de30f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294534:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294541:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294546:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294552:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135967.294555:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294569:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294577:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:1.0:1789135967.294579:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135967.294582:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.294587:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de30fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.294686:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11575:x1876044644673280:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 645us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135967.294694:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:0.0:1789135967.362679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.368982:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644673536 00000100:00100000:3.0:1789135967.368995:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644673536 00000100:00100000:3.0:1789135967.369120:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 96 00000100:00100000:3.0:1789135967.369132:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11578:x1876044644673536:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135967.369153:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135967.369175:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3101 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a33 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369253:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369269:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369280:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369295:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369302:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369309:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369418:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369427:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369435:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135967.369456:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789135967.369536:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369543:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369549:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369555:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135967.369559:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369566:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369579:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135967.369582:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.369587:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369773:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3108 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369785:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369790:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369805:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369810:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135967.369812:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369818:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369825:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135967.369828:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.369831:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369836:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de310f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369939:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3101 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 23 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369953:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 22 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.369961:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.369963:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135967.369965:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae000, rc 0) 00000100:00100000:3.0:1789135967.370032:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+22:11578:x1876044644673536:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 902us (7439us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789135967.370049:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 96 00000100:00100000:1.0:1789135967.376534:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.376706:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644673664 00000100:00100000:0.0:1789135967.376716:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644673664 00000100:00100000:0.0:1789135967.376816:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:0.0:1789135967.376839:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:11578:x1876044644673664:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:0.0:1789135967.376951:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.376968:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.376980:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377030:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377038:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377044:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377049:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135967.377053:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377060:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377071:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:0.0:1789135967.377075:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135967.377090:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.377097:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3124 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135967.377185:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:11578:x1876044644673664:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 346us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135967.377193:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:2.0:1789135967.379755:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.379906:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644673920 00000100:00100000:0.0:1789135967.379915:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644673920 00000100:00100000:0.0:1789135967.379967:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789135967.379976:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+22:11578:x1876044644673920:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135967.380291:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:11578:x1876044644673920:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 315us (544us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789135967.380299:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1789135967.429703:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135967.429890:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644674176 00000100:00100000:1.0:1789135967.429901:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644674176 00000100:00100000:1.0:1789135967.429963:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:1.0:1789135967.429974:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+23:11106:x1876044644674176:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135967.430000:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135967.430020:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de312b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a3a expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.430169:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.430184:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 24 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.430213:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.430247:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 24 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.430261:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 24 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.430274:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6688000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666790272:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135967.430389:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c381e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135967.438157:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6688000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666790272:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135967.438191:0:8299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135967.443288:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.443533:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644674304 00000100:00100000:3.0:1789135967.443544:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644674304 00010000:00010000:3.0:1789135967.443602:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 25 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135967.443647:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:3.0:1789135967.443657:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+25:2392:x1876044644674304:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135967.443672:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135967.443679:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 25 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.443693:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 25 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.443718:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a33 expref: 25 pid: 14529 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.443734:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.443739:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.443749:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.443771:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.443804:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135967.443914:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+24:2392:x1876044644674304:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 257us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135967.443922:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00010000:00010000:1.0:1789135967.444133:0:8299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.444142:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135967.444163:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789135967.444349:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de312b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 25 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.444368:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 24 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.444377:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:1.0:1789135967.444379:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135967.444382:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135967.444429:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+24:11106:x1876044644674176:12345-192.168.201.31@tcp:101:bash.0 Request processed in 14458us (14738us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789135967.444437:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:1.0:1789135967.449405:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.449544:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644674432 00000100:00100000:3.0:1789135967.449555:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644674432 00000100:00100000:3.0:1789135967.449635:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:3.0:1789135967.449646:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+24:11106:x1876044644674432:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135967.449676:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135967.449700:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3140 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a41 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.449734:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3147 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.449748:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.449758:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3147 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.449920:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3140 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a41 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.449939:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3147 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a41 expref: 25 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.449957:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.449961:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135967.449965:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae600, rc 0) 00000100:00100000:3.0:1789135967.450035:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+25:11106:x1876044644674432:12345-192.168.201.31@tcp:101:bash.0 Request processed in 391us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135967.450042:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:2.0:1789135967.455996:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.456289:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644674688 00000100:00100000:3.0:1789135967.456302:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644674688 00000100:00100000:3.0:1789135967.456382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:3.0:1789135967.456392:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+25:11106:x1876044644674688:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:3.0:1789135967.457021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.457041:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.457053:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135967.457112:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789135967.457137:0:6517:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000757b2ad7 reply state 00000000ad3e85c6 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.457150:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.457157:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.457160:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135967.457177:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789135967.457219:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1789135967.457378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+29:11106:x1876044644674688:12345-192.168.201.31@tcp:36:bash.0 Request processed in 984us (1390us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789135967.457387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 100 00000020:00080000:3.0:1789135967.457392:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789135967.460086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.460217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644674816 00000100:00100000:3.0:1789135967.460227:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644674816 00000100:00100000:3.0:1789135967.460285:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:3.0:1789135967.460296:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+29:11106:x1876044644674816:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135967.460330:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135967.460350:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3155 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a48 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.460408:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3155 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a48 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.460584:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3155 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a48 expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.460672:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.460675:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135967.460679:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:3.0:1789135967.460735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+30:11106:x1876044644674816:12345-192.168.201.31@tcp:101:bash.0 Request processed in 441us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135967.460743:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:1.0:1789135967.463971:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.464101:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644674944 00000100:00100000:0.0:1789135967.464112:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644674944 00000100:00100000:0.0:1789135967.464173:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:0.0:1789135967.464183:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:11106:x1876044644674944:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135967.464202:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135967.464225:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a4f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135967.464251:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa40c5d, atime: 0x6aa40c5b, ctime: 0x6aa40c5d, blocks: 0x8 00010000:00010000:0.0:1789135967.464272:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:0.0:1789135967.464277:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135967.464286:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.464303:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.464343:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e600, rc 0) 00000100:00100000:0.0:1789135967.464430:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:11106:x1876044644674944:12345-192.168.201.31@tcp:101:bash.0 Request processed in 239us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135967.464438:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00010000:00010000:1.0:1789135967.464781:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135967.470256:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.470768:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644675072 00000100:00100000:0.0:1789135967.470778:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644675072 00002000:00010000:0.0:1789135967.470824:0:8435:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:0.0:1789135967.470829:0:8435:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c460c000 with x1876044644675072 ext(0->18446744073709551615) 00002000:00010000:0.0:1789135967.470841:0:8435:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c460c000. 00000100:00100000:3.0:1789135967.471156:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:3.0:1789135967.471168:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2389:x1876044644675072:12345-192.168.201.31@tcp:10:bash.0 00002000:00010000:3.0:1789135967.471773:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789135967.471778:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789135965 -> 1789135967 00002000:00010000:3.0:1789135967.471780:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789135963 -> 1789135963 00002000:00010000:3.0:1789135967.471783:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789135965 -> 1789135967 00002000:00010000:3.0:1789135967.471785:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789135967.471994:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2389:x1876044644675072:12345-192.168.201.31@tcp:10:bash.0 Request processed in 827us (1751us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789135967.472004:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00002000:00010000:3.0:1789135967.472009:0:8436:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789135967.472012:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c460c000 with x1876044644675072 ext(0->18446744073709551615) 00002000:00010000:3.0:1789135967.472019:0:8436:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c460c000. 00000100:00100000:2.0:1789135967.594718:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.594887:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644675200 00000100:00100000:3.0:1789135967.594899:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644675200 00000100:00100000:3.0:1789135967.595006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:3.0:1789135967.595027:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+30:11592:x1876044644675200:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:3.0:1789135967.595294:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595323:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595338:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595356:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595363:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595387:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595496:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595505:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595512:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135967.595563:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595574:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595580:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595586:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595604:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135967.595607:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595615:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595627:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135967.595636:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.595643:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595649:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595661:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595666:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595672:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595676:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135967.595679:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595685:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595693:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135967.595695:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.595698:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595703:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de316a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595716:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595729:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595735:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595740:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135967.595742:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595748:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595756:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.595759:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135967.595761:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.595766:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de3171 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135967.596184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+30:11592:x1876044644675200:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 834us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135967.596194:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:1.0:1789135967.688936:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.689048:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644675456 00000100:00100000:0.0:1789135967.689058:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644675456 00000100:00100000:0.0:1789135967.689129:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:0.0:1789135967.689140:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+30:11595:x1876044644675456:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135967.689168:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135967.689189:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3178 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a56 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689262:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689278:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689290:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689305:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689333:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689340:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689449:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de318d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689460:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de318d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689467:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de318d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135967.689479:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789135967.689553:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689560:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689567:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689573:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135967.689577:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689597:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689621:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135967.689624:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135967.689629:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689636:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de317f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689650:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689656:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689662:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689668:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135967.689670:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689676:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689684:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135967.689686:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135967.689689:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689694:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689747:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3178 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a56 expref: 33 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689761:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de318d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a56 expref: 32 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.689768:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:0.0:1789135967.689770:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135967.689773:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e800, rc 0) 00000100:00100000:0.0:1789135967.689839:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11595:x1876044644675456:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 703us (914us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789135967.689847:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:2.0:1789135967.700301:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135967.700495:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644675584 00000100:00100000:3.0:1789135967.700505:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644675584 00000100:00100000:3.0:1789135967.700576:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:3.0:1789135967.700598:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11595:x1876044644675584:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1789135967.700673:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.700704:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 32 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.700713:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.700750:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 32 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.700764:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 32 pid: 8299 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135967.700778:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666790400:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135967.700943:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789135967.705540:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135967.705659:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644675840 00000100:00100000:1.0:1789135967.705669:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644675840 00000100:00100000:1.0:1789135967.705740:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:1.0:1789135967.705752:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+33:6164:x1876044644675840:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789135967.706124:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+34:6164:x1876044644675840:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 373us (594us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789135967.706133:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1789135967.707244:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666790400:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135967.707273:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135967.712061:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135967.712237:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644675968 00000100:00100000:1.0:1789135967.712249:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644675968 00010000:00010000:1.0:1789135967.712297:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 34 pid: 8299 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.712350:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1789135967.712361:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+34:2392:x1876044644675968:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135967.712378:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135967.712385:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 34 pid: 8299 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.712397:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 34 pid: 8299 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.712453:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3132 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a3a expref: 34 pid: 8299 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.712472:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:1.0:1789135967.712478:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.712487:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.712494:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135967.712522:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135967.713326:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713337:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713379:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713386:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713404:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713409:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135967.713414:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713431:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713444:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:3.0:1789135967.713447:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135967.713451:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135967.713458:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de319b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135967.713639:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+33:2392:x1876044644675968:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 1277us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135967.713648:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:3.0:1789135967.715603:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11595:x1876044644675584:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 14998us (15293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135967.715617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:2.0:1789135967.720350:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135967.720548:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644676224 00000100:00100000:1.0:1789135967.720558:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644676224 00000100:00100000:1.0:1789135967.720737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:1.0:1789135967.720749:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+32:11595:x1876044644676224:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135967.721015:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+33:11595:x1876044644676224:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 268us (673us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789135967.721034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1789135967.925688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.926342:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644676480 00000100:00100000:0.0:1789135967.926357:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644676480 00000100:00100000:0.0:1789135967.926481:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 105 00000100:00100000:0.0:1789135967.926490:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+33:11607:x1876044644676480:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:0.0:1789135967.926512:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135967.926531:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a5d expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926593:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926617:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926652:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926670:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926678:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926685:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926817:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de31b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926827:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de31b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926832:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de31b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135967.926841:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789135967.926941:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926946:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926951:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926955:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135967.926964:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926969:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.926979:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135967.926981:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135967.926985:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927002:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927025:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927031:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927036:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927041:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135967.927044:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927050:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927056:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135967.927059:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135967.927077:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927084:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927121:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a5d expref: 36 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927130:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de31b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a5d expref: 35 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135967.927135:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:0.0:1789135967.927137:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135967.927139:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f600, rc 0) 00000100:00100000:0.0:1789135967.927198:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+35:11607:x1876044644676480:12345-192.168.201.31@tcp:101:cat.0 Request processed in 710us (1906us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789135967.927203:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 105 00000100:00100000:2.0:1789135967.934682:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135967.934759:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644676736 00000100:00100000:0.0:1789135967.934775:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644676736 00000100:00100000:0.0:1789135967.935010:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:0.0:1789135967.935109:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+35:11607:x1876044644676736:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:0.0:1789135967.935521:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+36:11607:x1876044644676736:12345-192.168.201.31@tcp:35:cat.0 Request processed in 415us (854us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789135967.935529:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1789135968.016449:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.016620:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644676992 00000100:00100000:0.0:1789135968.016640:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644676992 00000100:00100000:0.0:1789135968.016730:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:0.0:1789135968.016741:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+36:11608:x1876044644676992:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:0.0:1789135968.016820:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789135968.016914:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3155 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a48 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.016942:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de31b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a5d expref: 35 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.016954:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de318d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a56 expref: 34 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.016965:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a41 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.016974:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:0.0:1789135968.016979:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135968.017002:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017027:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017036:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017052:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017059:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017087:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017168:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017176:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017183:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789135968.017436:0:14528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789135968.017447:0:14528:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416136592249ns, next at 417136589304ns, rc = 0 00010000:00010000:0.0:1789135968.017499:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017508:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017516:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017522:0:14528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017528:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017533:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017557:0:14528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135968.017576:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017582:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017588:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017593:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135968.017597:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017604:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017613:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:0.0:1789135968.017615:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789135968.017619:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017624:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de31d3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017639:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017644:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017660:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017665:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135968.017668:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017674:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017682:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135968.017684:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.017687:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017691:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de31c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135968.017701:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000401d3214 reply state 00000000ece55752 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017712:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.017717:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135968.017720:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135968.017722:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135968.017814:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+34:11608:x1876044644676992:12345-192.168.201.31@tcp:36:rm.0 Request processed in 1074us (1380us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789135968.017823:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 106 00010000:00010000:1.0:1789135968.018196:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135968.018205:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.018224:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135968.018227:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.018235:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.018245:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:1.0:1789135968.018248:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789135968.018251:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.018256:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de31da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.018270:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135968.018274:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135968.018277:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135968.092045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.092160:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644677248 00000100:00100000:1.0:1789135968.092176:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644677248 00000100:00100000:1.0:1789135968.092373:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:1.0:1789135968.092387:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+34:11614:x1876044644677248:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135968.092433:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135968.092462:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de31e1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a64 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.092579:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.092616:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.092630:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.092644:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.092653:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.092658:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135968.093556:0:8299:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789135968.093704:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093716:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093725:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093757:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093763:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093769:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093785:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135968.093790:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093797:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093809:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135968.093812:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135968.093817:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.093823:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de31e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135968.095033:0:8299:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000a48bd7d reply state 000000003a2f0635 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.095057:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.095074:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135968.095078:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135968.095082:0:8299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789135968.095132:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de31e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 37 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.095158:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 36 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.095184:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:1.0:1789135968.095187:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135968.095191:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135968.095268:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+37:11614:x1876044644677248:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2884us (3239us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789135968.095277:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:2.0:1789135968.110557:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.110698:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644677376 00000100:00100000:0.0:1789135968.110709:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644677376 00000100:00100000:0.0:1789135968.110840:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:0.0:1789135968.110850:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644677376:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135968.110903:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.110927:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a6b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135968.110954:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789135968.110978:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1789135968.110983:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135968.111008:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.111029:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.111042:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f200, rc 0) 00000100:00100000:0.0:1789135968.111121:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644677376:12345-192.168.201.31@tcp:101:bash.0 Request processed in 272us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.111129:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00080000:1.0:1789135968.112781:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135968.123407:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.123501:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644677504 00000100:00100000:3.0:1789135968.123512:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644677504 00000100:00100000:3.0:1789135968.123572:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1789135968.123581:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:11614:x1876044644677504:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135968.123597:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.123614:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a72 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.123659:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.123667:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135968.123670:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135968.123674:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.123703:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.123714:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.123725:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876044666790528:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135968.123820:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.129822:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1876044666790528:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135968.129891:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.129914:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae400, rc 0) 00000100:00100000:0.0:1789135968.130012:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:11614:x1876044644677504:12345-192.168.201.31@tcp:101:bash.0 Request processed in 6430us (6615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.130021:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1789135968.131385:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.131670:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644677632 00000100:00100000:3.0:1789135968.131678:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644677632 00010000:00010000:3.0:1789135968.131727:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.131770:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:3.0:1789135968.131780:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644677632:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135968.131796:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135968.131831:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.131846:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.131928:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d98f0392/0x559c8745c6de3204 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a6b expref: 9 pid: 8430 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.131949:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135968.131954:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135968.131964:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.131973:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.132025:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.132040:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44cb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1876044666790656:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789135968.132141:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789135968.139238:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.139348:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44cb0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1876044666790656:192.168.201.31@tcp:105: 00010000:00010000:3.0:1789135968.139380:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135968.139432:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644677632:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 7654us (8054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.139456:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:1.0:1789135968.139568:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644677888 00000100:00100000:1.0:1789135968.139574:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644677888 00000100:00100000:1.0:1789135968.139615:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:1.0:1789135968.139623:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+37:11614:x1876044644677888:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:1.0:1789135968.139903:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11614:x1876044644677888:12345-192.168.201.31@tcp:35:bash.0 Request processed in 281us (676us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789135968.139909:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1789135968.351178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.351255:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644678016 00000100:00100000:3.0:1789135968.351265:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644678016 00000100:00100000:3.0:1789135968.351330:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:3.0:1789135968.351340:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:11630:x1876044644678016:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.351363:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.351383:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a79 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.351452:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3219 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.351466:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.351477:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.351523:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789135968.351526:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135968.351544:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3219 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.351566:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a79 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.351584:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3219 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a79 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.351611:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135968.351614:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135968.351618:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafc00, rc 0) 00000100:00100000:3.0:1789135968.351674:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+39:11630:x1876044644678016:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 336us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.351682:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:2.0:1789135968.357931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.358036:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644678272 00000100:00100000:0.0:1789135968.358046:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644678272 00000100:00100000:0.0:1789135968.358122:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:0.0:1789135968.358134:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4622580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+39:11630:x1876044644678272:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135968.358155:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.358177:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3220 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a80 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.358282:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de3227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.358295:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de3227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.358319:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de3227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135968.358330:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789135968.358433:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3220 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a80 expref: 42 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.358450:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de3227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a80 expref: 41 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.358458:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:0.0:1789135968.358461:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135968.358477:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e800, rc 0) 00000100:00100000:0.0:1789135968.358537:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4622580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+41:11630:x1876044644678272:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 405us (617us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789135968.358545:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:2.0:1789135968.362722:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.362802:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644678528 00000100:00100000:3.0:1789135968.362811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644678528 00000100:00100000:3.0:1789135968.362952:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:3.0:1789135968.362962:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+41:11630:x1876044644678528:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.362985:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.363004:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3235 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a87 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.363378:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de323c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.363394:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de323c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.363404:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de323c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.363427:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789135968.363527:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3235 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a87 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.363563:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de323c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a87 expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.363571:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:3.0:1789135968.363574:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789135968.363578:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caec00, rc 0) 00000100:00100000:3.0:1789135968.363644:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+43:11630:x1876044644678528:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 683us (932us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789135968.363652:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:2.0:1789135968.368486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.368562:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644678656 00000100:00100000:0.0:1789135968.368573:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644678656 00000100:00100000:0.0:1789135968.368644:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1789135968.368654:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+43:2391:x1876044644678656:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135968.368670:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135968.368695:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de3227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a80 expref: 43 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.368714:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:0.0:1789135968.368718:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135968.368774:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+42:2391:x1876044644678656:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.368780:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1789135968.375347:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.376033:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644678784 00000100:00100000:0.0:1789135968.376046:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644678784 00000100:00100000:0.0:1789135968.376168:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:0.0:1789135968.376180:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644678784:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:0.0:1789135968.376225:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.376249:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.376275:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135968.376279:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135968.376284:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.376334:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.376348:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 8 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.376362:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4498b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1876044666790784:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135968.376484:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.379264:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4498b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8430:1876044666790784:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135968.379308:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.381167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.381547:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644678912 00000100:00100000:0.0:1789135968.381556:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644678912 00002000:00100000:0.0:1789135968.381608:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90a6c4620b40 x1876044644678912/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:399/0 lens 504/0 e 0 to 0 dl 1789135979 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135968.381620:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c4620b40 with x1876044644678912 ext(0->8) 00010000:00010000:0.0:1789135968.381628:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 9 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.381663:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 9 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135968.381671:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a6c4620b40 00000100:00100000:0.0:1789135968.381711:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1789135968.381721:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644678912:12345-192.168.201.31@tcp:4:lfs.0 00000100:00100000:0.0:1789135968.383119:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2391:x1876044644678912:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 1394us (1956us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789135968.383130:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00002000:00100000:0.0:1789135968.383139:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90a6c4620b40 x1876044644678912/t4294967303(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:399/0 lens 504/448 e 0 to 0 dl 1789135979 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135968.383149:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c4620b40 with x1876044644678912 ext(0->8) 00010000:00010000:0.0:1789135968.383158:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 11 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.383173:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 11 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135968.383181:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a6c4620b40 00000100:00100000:3.0:1789135968.385969:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.386272:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644679040 00000100:00100000:1.0:1789135968.386282:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644679040 00010000:00010000:1.0:1789135968.386388:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 11 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.386480:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:1.0:1789135968.386491:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2392:x1876044644679040:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135968.386507:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789135968.386525:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789135968.386541:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789135967 00002000:00010000:1.0:1789135968.386543:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789135967 00002000:00010000:1.0:1789135968.386545:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789135967 00002000:00010000:1.0:1789135968.386548:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789135968.386556:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 11 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.386569:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 11 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.386595:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de320b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a72 expref: 11 pid: 8432 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.386614:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135968.386618:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135968.386624:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.386633:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.386671:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135968.386730:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2392:x1876044644679040:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 241us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.386738:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00010000:00010000:0.0:1789135968.386813:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.386822:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388161:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388170:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388178:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388185:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135968.388190:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388199:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388218:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.388226:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f6e6d5/0x559c8745c6de324a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.388334:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2392:x1876044644678784:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 12153us (12997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.388343:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1789135968.391450:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135968.391723:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644679296 00000100:00100000:2.0:1789135968.391733:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644679296 00000100:00100000:2.0:1789135968.391792:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:2.0:1789135968.391803:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+42:11630:x1876044644679296:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:2.0:1789135968.392010:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de323c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a87 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135968.392252:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789135968.392284:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789135968.392635:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789135968.392674:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.392688:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 46 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.392695:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.392734:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 46 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.392748:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 46 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.392761:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4621680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1876044666790912:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135968.396438:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.396621:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644679424 00000100:00100000:0.0:1789135968.396630:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644679424 00010000:00010000:0.0:1789135968.396672:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 47 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.396716:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:0.0:1789135968.396725:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+47:2392:x1876044644679424:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135968.396741:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135968.396747:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 47 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.396760:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 47 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.396787:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:0.0:1789135968.396793:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.396801:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.396809:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.396828:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135968.396917:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+47:2392:x1876044644679424:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 192us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.396925:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:2.0:1789135968.397559:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789135968.397593:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de31f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a64 expref: 46 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.397611:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4621680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1876044666790912:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135968.397639:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.397648:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.397655:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135968.397758:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1789135968.397911:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1789135968.398004:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4621680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666791040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135968.398075:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135968.398107:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2481cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.398791:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666791040 00000100:00100000:0.0:1789135968.398814:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666791040 00000100:00100000:0.0:1789135968.398903:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789135968.398912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1876044666791040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789135968.399001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4622d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6518:x1876044666791040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.399009:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1789135968.399121:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135968.401797:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4621680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666791040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789135968.402195:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789135968.402285:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4621680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666791168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135968.402680:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135968.402764:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44840 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.402806:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666791168 00000100:00100000:0.0:1789135968.402813:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666791168 00000100:00100000:0.0:1789135968.403114:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789135968.403125:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6518:x1876044666791168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789135968.403269:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6518:x1876044666791168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 146us (590us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789135968.403277:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789135968.403342:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4621680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666791168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789135968.403389:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789135968.403437:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.403448:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.403456:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.403462:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135968.403467:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.403475:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.403490:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:2.0:1789135968.403493:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789135968.403498:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135968.403504:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3251 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135968.403592:0:6518:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789135968.403666:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789135968.403676:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416522820991ns, next at 417522818894ns, rc = 0 00000001:00080000:2.0:1789135968.403682:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789135968.403703:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a6c2b0fc00) 00010000:00010000:2.0:1789135968.403706:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135968.403714:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de323c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a87 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.403813:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+49:11630:x1876044644679296:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 12012us (12373us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789135968.403821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000020:00080000:2.0:1789135968.403824:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789135968.407382:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.407450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644679552 00000100:00100000:3.0:1789135968.407460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644679552 00000100:00100000:3.0:1789135968.407520:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 111 00000100:00100000:3.0:1789135968.407530:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+49:11630:x1876044644679552:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.407552:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.407576:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3258 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a8e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.407631:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a8e expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.407645:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3258 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a8e expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.407685:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.407688:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135968.407692:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:3.0:1789135968.407756:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+50:11630:x1876044644679552:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 227us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.407763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 111 00000100:00100000:1.0:1789135968.412183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.412269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644679808 00000100:00100000:0.0:1789135968.412280:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644679808 00000100:00100000:0.0:1789135968.412347:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:0.0:1789135968.412357:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+50:11630:x1876044644679808:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135968.412614:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+51:11630:x1876044644679808:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 257us (440us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789135968.412622:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00010000:00010000:0.0:1789135968.488097:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135968.524368:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.524527:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644679936 00000100:00100000:0.0:1789135968.524538:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644679936 00000100:00100000:0.0:1789135968.524613:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:0.0:1789135968.524623:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4622940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+51:11640:x1876044644679936:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:0.0:1789135968.524701:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524731:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524742:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524753:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524760:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524766:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524848:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524885:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524891:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789135968.524935:0:14528:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524947:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524953:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524969:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524975:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135968.524979:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524987:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.524999:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135968.525002:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.525006:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525013:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de325f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525026:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525032:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525038:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525043:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135968.525046:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525071:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525080:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135968.525082:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.525085:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525090:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525099:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525104:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525109:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525113:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135968.525116:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525121:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525126:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135968.525128:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135968.525130:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.525144:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de326d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.525220:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4622940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+51:11640:x1876044644679936:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 598us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.525228:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:3.0:1789135968.573116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.573235:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644680192 00000100:00100000:1.0:1789135968.573260:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644680192 00000100:00100000:1.0:1789135968.573331:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:1.0:1789135968.573343:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+51:11643:x1876044644680192:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135968.573366:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135968.573390:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3274 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a95 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573484:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573499:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573511:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573522:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573529:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573535:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573636:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573644:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573650:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135968.573664:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789135968.573734:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573742:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573749:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573755:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135968.573759:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573768:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573779:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135968.573782:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135968.573787:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573793:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de327b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573807:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573812:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573827:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573831:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135968.573834:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573840:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.573846:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135968.573849:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135968.573851:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.574025:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3282 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.574075:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3274 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 54 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.574088:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 53 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.574095:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135968.574097:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135968.574099:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879e00, rc 0) 00000100:00100000:1.0:1789135968.574172:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+53:11643:x1876044644680192:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 831us (1065us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789135968.574189:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:1.0:1789135968.578363:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.578478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644680320 00000100:00100000:3.0:1789135968.578488:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644680320 00000100:00100000:3.0:1789135968.578545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:3.0:1789135968.578555:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+53:11643:x1876044644680320:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1789135968.578630:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578648:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578659:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578696:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578703:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578709:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578733:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135968.578738:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578747:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578759:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.578763:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135968.578767:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.578773:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de3297 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.578884:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+53:11643:x1876044644680320:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 330us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.578893:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:2.0:1789135968.582605:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.582710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644680576 00000100:00100000:0.0:1789135968.582724:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644680576 00000100:00100000:0.0:1789135968.582790:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:0.0:1789135968.582801:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+53:11643:x1876044644680576:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135968.583112:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11643:x1876044644680576:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 312us (517us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789135968.583120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1789135968.616463:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135968.616489:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666791296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135968.616578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135968.616792:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666791296 00000100:00100000:0.0:1789135968.616800:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666791296 00000100:00100000:0.0:1789135968.616899:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135968.616910:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666791296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135968.616952:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789135968.616997:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666791296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.617004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789135968.617137:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666791296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135968.674716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.674892:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644680832 00000100:00100000:0.0:1789135968.674902:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644680832 00000100:00100000:0.0:1789135968.674968:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:0.0:1789135968.674988:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11653:x1876044644680832:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135968.675032:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.675036:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789135968.675080:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3219 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a79 expref: 54 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.675101:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:0.0:1789135968.675107:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135968.675120:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de329e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08a9c expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.675244:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.675259:0:14528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 54 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.675268:0:14528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.675302:0:14528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 54 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.675315:0:14528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 54 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.675330:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4498000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666791424:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135968.675600:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1789135968.683926:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4498000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666791424:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135968.683989:0:14528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135968.687905:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.688006:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644680960 00000100:00100000:3.0:1789135968.688016:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644680960 00010000:00010000:3.0:1789135968.688065:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 55 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.688113:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:3.0:1789135968.688124:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+55:2391:x1876044644680960:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135968.688153:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135968.688160:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 55 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.688173:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 55 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.688195:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3289 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a95 expref: 55 pid: 8299 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.688211:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.688217:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.688225:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.688232:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.688256:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135968.688313:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+54:2391:x1876044644680960:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 191us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.688321:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00010000:00010000:0.0:1789135968.689506:0:14528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.689518:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135968.689540:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789135968.689679:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de329e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 55 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.689697:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 54 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.689705:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135968.689707:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135968.689710:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e200, rc 0) 00000100:00100000:0.0:1789135968.689772:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11653:x1876044644680832:12345-192.168.201.31@tcp:101:bash.0 Request processed in 14785us (15070us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789135968.689781:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:2.0:1789135968.699963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.700065:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644681088 00000100:00100000:3.0:1789135968.700076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644681088 00000100:00100000:3.0:1789135968.700140:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:3.0:1789135968.700152:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4621a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+54:11653:x1876044644681088:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135968.700191:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.700211:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de32b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08aa3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.700246:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.700261:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.700273:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.700401:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de32b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 56 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.700419:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.700428:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.700431:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135968.700435:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caea00, rc 0) 00000100:00100000:3.0:1789135968.700504:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4621a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+55:11653:x1876044644681088:12345-192.168.201.31@tcp:101:bash.0 Request processed in 354us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.700512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:1.0:1789135968.703777:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.705016:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644681344 00000100:00100000:3.0:1789135968.705029:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644681344 00000100:00100000:3.0:1789135968.705130:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:3.0:1789135968.705141:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+55:11653:x1876044644681344:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:3.0:1789135968.706428:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.706452:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.706464:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135968.706522:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789135968.706548:0:6515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000555f3615 reply state 00000000fcbc8688 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.706560:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.706568:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.706571:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135968.706575:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135968.706691:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+58:11653:x1876044644681344:12345-192.168.201.31@tcp:36:bash.0 Request processed in 1548us (2921us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789135968.706701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000020:00080000:3.0:1789135968.706707:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789135968.716499:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.717449:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644681472 00000100:00100000:3.0:1789135968.717461:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644681472 00000100:00100000:3.0:1789135968.717522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:3.0:1789135968.717533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+58:11653:x1876044644681472:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135968.717563:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.717587:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de32c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08aaa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.717713:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.717742:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 59 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.717753:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.717790:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 59 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.717808:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 59 pid: 14528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.717823:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44cb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666791552:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135968.718222:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789135968.727662:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.727805:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44cb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666791552:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135968.727844:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.728031:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644681600 00000100:00100000:0.0:1789135968.728039:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644681600 00010000:00010000:0.0:1789135968.728092:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 60 pid: 14528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.728130:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:0.0:1789135968.728140:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+60:2391:x1876044644681600:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135968.728169:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135968.728178:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 60 pid: 14528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.728190:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 60 pid: 14528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.728211:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de32a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a9c expref: 60 pid: 14528 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.728227:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135968.728232:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.728243:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.728251:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.728281:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135968.728338:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+59:2391:x1876044644681600:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 199us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135968.728347:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00010000:00010000:1.0:1789135968.728956:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.728968:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135968.729033:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789135968.729039:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135968.729072:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.729106:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de32c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.729122:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 58 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.729129:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135968.729132:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135968.729144:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf000, rc 0) 00000100:00100000:1.0:1789135968.729194:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+58:11653:x1876044644681472:12345-192.168.201.31@tcp:101:bash.0 Request processed in 11662us (12703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.729202:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:2.0:1789135968.745178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.746203:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644681856 00000100:00100000:0.0:1789135968.746215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644681856 00000100:00100000:0.0:1789135968.746342:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789135968.746352:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+58:11653:x1876044644681856:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:0.0:1789135968.746609:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+59:11653:x1876044644681856:12345-192.168.201.31@tcp:35:bash.0 Request processed in 257us (1440us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1789135968.746617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:2.0:1789135968.869420:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.869556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644681984 00000100:00100000:3.0:1789135968.869566:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644681984 00000100:00100000:3.0:1789135968.869630:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:3.0:1789135968.869641:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+59:11659:x1876044644681984:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.869665:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.869687:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de32d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ab1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.869763:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de32dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.869795:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de32dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.869807:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de32dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135968.869894:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789135968.869898:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135968.869917:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de32dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.869943:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de32d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab1 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.869961:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de32dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab1 expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.869971:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135968.869974:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135968.869978:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:3.0:1789135968.870236:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+60:11659:x1876044644681984:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 595us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.870244:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:3.0:1789135968.873433:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.873578:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644682112 00000100:00100000:1.0:1789135968.873587:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644682112 00000100:00100000:1.0:1789135968.873648:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:1.0:1789135968.873658:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+60:11659:x1876044644682112:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135968.873678:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135968.873699:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de32e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ab8 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873778:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873794:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873806:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873818:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873825:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873832:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873951:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873973:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.873980:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135968.874247:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789135968.874252:0:14529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135968.874272:0:14529:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874283:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874303:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874309:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874315:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874321:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135968.874325:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874333:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874345:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135968.874355:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135968.874361:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874368:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de32eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874383:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874389:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874395:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874400:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135968.874402:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874407:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874414:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135968.874416:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135968.874419:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874424:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de32f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874451:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de32e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 62 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874478:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 61 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.874485:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135968.874487:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135968.874490:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135968.874553:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11659:x1876044644682112:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 896us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.874561:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:2.0:1789135968.887244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135968.887408:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644682368 00000100:00100000:0.0:1789135968.887418:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644682368 00000100:00100000:0.0:1789135968.887483:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:0.0:1789135968.887493:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11659:x1876044644682368:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135968.887514:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135968.887533:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3300 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08abf expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.887639:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.887655:0:14528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.887663:0:14528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 62 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.887672:0:14528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.887707:0:14528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 62 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.887720:0:14528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 62 pid: 14529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135968.888446:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.888518:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644682496 00000100:00100000:1.0:1789135968.888524:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644682496 00010000:00010000:1.0:1789135968.888553:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 63 pid: 14529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.888588:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:1.0:1789135968.888596:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+63:2392:x1876044644682496:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135968.888607:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135968.888613:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 63 pid: 14529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.889027:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4498000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666791680:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135968.889613:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 63 pid: 14529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.889641:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135968.889647:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.889667:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.889674:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135968.889707:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+63:2392:x1876044644682496:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 1112us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.889716:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 84 00010000:00010000:0.0:1789135968.898602:0:14528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.898625:0:14528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 62 pid: 6517 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.898642:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666791808:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135968.901642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135968.901714:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644682624 00000100:00100000:1.0:1789135968.901723:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644682624 00010000:00010000:1.0:1789135968.901775:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 63 pid: 6517 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135968.901818:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:1.0:1789135968.901828:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+63:2391:x1876044644682624:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135968.901842:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135968.901849:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 6/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 63 pid: 6517 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.901892:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 63 pid: 6517 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.901915:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135968.901921:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.901931:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.901959:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135968.901979:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135968.902040:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+63:2391:x1876044644682624:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 213us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135968.902048:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:0.0:1789135968.905469:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc300 going to sleep for 11 seconds 00010000:00010000:0.0:1789135968.905526:0:14528:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.31@tcp) returned -22 from blocking AST (req@0000000036285a08 x1876044666791680) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 62 pid: 14529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.905547:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de32f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab8 expref: 62 pid: 14529 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.905566:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4498000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666791680:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135968.905580:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de32cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aaa expref: 61 pid: 6517 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135968.905589:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666791808:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135968.905612:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135968.905620:0:14528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.905651:0:14528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.905657:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135968.905680:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135968.906751:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de3300 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 62 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.906774:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 61 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135968.906782:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135968.906784:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135968.906787:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f600, rc 0) 00000100:00100000:0.0:1789135968.906889:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11659:x1876044644682368:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 19363us (19619us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789135968.906898:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:2.0:1789135968.913341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.913424:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644682880 00000100:00100000:3.0:1789135968.913434:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644682880 00000100:00100000:3.0:1789135968.913501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1789135968.913512:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11659:x1876044644682880:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:3.0:1789135968.913543:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135968.913568:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de3258 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a8e expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.913585:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.913590:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135968.913645:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+60:11659:x1876044644682880:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 134us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.913653:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:2.0:1789135968.916182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.916410:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644683008 00000100:00100000:3.0:1789135968.916420:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644683008 00000100:00100000:3.0:1789135968.916479:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:3.0:1789135968.916489:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6681680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+60:11659:x1876044644683008:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:3.0:1789135968.916597:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.916614:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.916626:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135968.916889:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789135968.916979:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6681680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+60:11659:x1876044644683008:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 490us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.916987:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:2.0:1789135968.920684:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135968.920831:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644683136 00000100:00100000:3.0:1789135968.920840:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644683136 00000100:00100000:3.0:1789135968.920946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:3.0:1789135968.920958:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6680f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+60:11659:x1876044644683136:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135968.920982:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135968.921017:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ac6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.921083:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.921095:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.921115:0:6515:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.921128:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.921141:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135968.921143:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135968.921147:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135968.921155:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:3.0:1789135968.921215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6680f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11659:x1876044644683136:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 259us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135968.921223:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000040:00080000:2.0:1789135969.064435:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135969.064456:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135969.064499:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789135969.064509:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135969.064804:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666791936:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135969.065097:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c6319cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.069947:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135969.070083:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666791936:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135969.070364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644683264 00000100:00100000:3.0:1789135969.070386:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644683264 00000100:00100000:3.0:1789135969.070462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:3.0:1789135969.070472:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11660:x1876044644683264:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135969.070503:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135969.070636:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11660:x1876044644683264:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 165us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.070644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00080000:1.0:1789135969.070973:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135969.076758:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135969.076832:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644683392 00000100:00100000:1.0:1789135969.076842:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644683392 00000100:00100000:1.0:1789135969.076923:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:1.0:1789135969.076933:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11660:x1876044644683392:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.077018:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077036:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077056:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077074:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077082:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077089:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077127:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077137:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077143:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135969.077191:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789135969.077196:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135969.077209:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077221:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077228:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077234:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077240:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.077244:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077252:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077264:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:1.0:1789135969.077273:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.077279:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077286:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de3323 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077304:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077311:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077316:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077322:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.077325:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077331:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077339:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff90a6c2b0f200) 00010000:00010000:1.0:1789135969.077342:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.077345:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077351:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de332a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077366:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077379:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077384:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077390:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.077393:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077399:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077407:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135969.077410:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.077413:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.077419:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3331 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.077501:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11660:x1876044644683392:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 568us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.077510:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:2.0:1789135969.081092:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.081151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644683648 00000100:00100000:3.0:1789135969.081160:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644683648 00000100:00100000:3.0:1789135969.081222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:3.0:1789135969.081235:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+61:11660:x1876044644683648:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135969.081257:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135969.081278:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de3338 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08acd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081393:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081409:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081431:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135969.081444:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789135969.081520:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081546:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081553:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081559:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135969.081563:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081571:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081582:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135969.081585:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789135969.081589:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081595:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de333f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081634:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de3338 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08acd expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081645:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:3.0:1789135969.081647:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135969.081651:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de3338 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08acd expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.081661:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf200, rc 0) 00000100:00100000:3.0:1789135969.081734:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+62:11660:x1876044644683648:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 501us (652us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1789135969.081742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:2.0:1789135969.093481:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.093551:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644683776 00000100:00100000:3.0:1789135969.093560:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644683776 00000100:00100000:3.0:1789135969.093625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:3.0:1789135969.093636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c446cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+62:11660:x1876044644683776:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135969.093674:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135969.093792:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c446cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+62:11660:x1876044644683776:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 158us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.093800:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:2.0:1789135969.103914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.104354:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644684032 00000100:00100000:3.0:1789135969.104364:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644684032 00000100:00100000:3.0:1789135969.104421:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:3.0:1789135969.104430:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+62:11660:x1876044644684032:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135969.104450:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135969.104452:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789135969.104478:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de32dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ab1 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.104498:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:3.0:1789135969.104502:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135969.104515:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de334d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ad4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135969.105171:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789135969.106686:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3354 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.106723:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.106736:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3354 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.106829:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf200/0x559c8745c6de334d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ad4 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.106849:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3354 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ad4 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.106877:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7e0aa7100) 00010000:00010000:3.0:1789135969.106880:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135969.106883:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf400, rc 0) 00000100:00100000:3.0:1789135969.106976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+63:11660:x1876044644684032:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2546us (3071us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789135969.106985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:3.0:1789135969.127984:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.128813:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666792320:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.129447:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666792832:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.129527:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666793344:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.129574:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789135969.129588:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666792192:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129615:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.129632:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666792704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.129667:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666793216:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129688:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.129719:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644684288 00000100:00100000:3.0:1789135969.129726:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644684288 00000100:00100000:3.0:1789135969.129765:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792832 00000100:00100000:3.0:1789135969.129768:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792832 00000100:00100000:3.0:1789135969.129789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793344 00000100:00100000:3.0:1789135969.129792:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793344 00000100:00100000:3.0:1789135969.129804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792192 00000100:00100000:3.0:1789135969.129806:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792192 00000100:00100000:3.0:1789135969.129815:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792704 00000100:00100000:3.0:1789135969.129817:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792704 00000100:00100000:3.0:1789135969.129845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793216 00000100:00100000:3.0:1789135969.129848:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793216 00000100:00100000:3.0:1789135969.129885:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789135969.129893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666792832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.129949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666792832:12345-0@lo:400:kworker.0 Request processed in 57us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.129957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789135969.129974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789135969.129980:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666793344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.130007:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666793344:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.130013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1789135969.130224:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666792064:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130287:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666792576:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130336:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666793088:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130382:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666793600:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130423:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789135969.130430:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666792448:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130469:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666792960:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130507:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666793472:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.130547:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792448 00000100:00100000:1.0:1789135969.130551:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792448 00000100:00100000:1.0:1789135969.130574:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789135969.130581:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666792192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130613:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666792192:12345-0@lo:400:kworker.0 Request processed in 32us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.130619:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789135969.130631:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789135969.130637:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666792704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130664:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666792704:12345-0@lo:400:kworker.0 Request processed in 28us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.130671:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1789135969.130682:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789135969.130688:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666793216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130725:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666793216:12345-0@lo:400:kworker.0 Request processed in 37us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.130731:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789135969.130742:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789135969.130748:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3f84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666792448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.130778:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3f84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666792448:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.130784:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789135969.130801:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:1.0:1789135969.130807:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+63:11660:x1876044644684288:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.130894:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135969.130923:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3354 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ad4 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.130944:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7e0aa7100) 00010000:00010000:1.0:1789135969.130955:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135969.130981:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.130996:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.131005:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.131020:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.131237:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792320 00000100:00100000:0.0:1789135969.131242:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792320 00000100:00100000:0.0:1789135969.131296:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792576 00000100:00100000:0.0:1789135969.131300:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792576 00000100:00100000:0.0:1789135969.131316:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135969.131322:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666792320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131363:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666792320:12345-0@lo:400:kworker.0 Request processed in 41us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.131379:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789135969.131394:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789135969.131400:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666792576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131432:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666792576:12345-0@lo:400:kworker.0 Request processed in 32us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.131437:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789135969.131456:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793088 00000100:00100000:0.0:1789135969.131460:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793088 00000100:00100000:0.0:1789135969.131475:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793600 00000100:00100000:0.0:1789135969.131478:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793600 00000100:00100000:0.0:1789135969.131492:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792960 00000100:00100000:0.0:1789135969.131494:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792960 00000100:00100000:0.0:1789135969.131509:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793472 00000100:00100000:0.0:1789135969.131512:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793472 00000100:00100000:0.0:1789135969.131527:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789135969.131533:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1876044666793088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131565:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1876044666793088:12345-0@lo:400:kworker.0 Request processed in 32us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.131571:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789135969.131582:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789135969.131588:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666793600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131615:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666793600:12345-0@lo:400:kworker.0 Request processed in 28us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.131621:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789135969.131632:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789135969.131637:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666792960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131673:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666792960:12345-0@lo:400:kworker.0 Request processed in 36us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.131680:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789135969.131692:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789135969.131697:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666793472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131723:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666793472:12345-0@lo:400:kworker.0 Request processed in 26us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.131729:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789135969.131812:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789135969.131816:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135969.131833:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135969.131836:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135969.131892:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666792448:0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131903:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666792960:0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131912:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666793472:0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131922:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666792576:0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131932:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666793088:0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.131939:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666793600:0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.132022:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666792064 00000100:00100000:0.0:1789135969.132026:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666792064 00010000:00010000:1.0:1789135969.132153:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132164:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132213:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132221:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132228:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132234:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.132239:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132247:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132256:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:1.0:1789135969.132259:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.132264:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132270:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3362 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132282:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132295:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132301:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132305:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.132308:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132314:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132323:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xdc27cc8f (ffff90a6c2b0f200) 00010000:00010000:1.0:1789135969.132325:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.132328:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.132334:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3369 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xdc27cc8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.132410:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+62:11660:x1876044644684288:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1600us (4433us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789135969.132418:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:0.0:1789135969.132566:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789135969.132573:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666792064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135969.132616:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d63f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666792064:12345-0@lo:400:kworker.0 Request processed in 44us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.132632:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789135969.132665:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666793728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135969.132697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135969.132744:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666792064:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.134477:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666792192:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.134494:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666792704:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.134505:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666793216:0@lo:400:kworker.0 00000100:00100000:3.0:1789135969.134517:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666792320:0@lo:400:kworker.0 00010000:00080000:3.0:1789135969.134530:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c44cad00 x1876044666792832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135969.134540:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666792832:0@lo:400:kworker.0 00010000:00080000:3.0:1789135969.134551:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff6b21c0 x1876044666793344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135969.134564:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666793344:0@lo:400:kworker.0 00000100:00100000:1.0:1789135969.134711:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793728 00000100:00100000:1.0:1789135969.134718:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793728 00000100:00100000:1.0:1789135969.136522:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789135969.136543:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666793728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789135969.136570:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789135969.136678:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666793728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.136686:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789135969.136748:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4499e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666793728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135969.139425:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666793856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135969.139505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135969.139607:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666793856 00000100:00100000:2.0:1789135969.139615:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666793856 00000100:00100000:2.0:1789135969.139671:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789135969.139681:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3639:x1876044666793856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135969.139702:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135969.139754:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3639:x1876044666793856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.139762:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789135969.139811:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666793856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135969.139990:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135969.140176:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644684416 00000100:00100000:2.0:1789135969.140181:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644684416 00000100:00100000:2.0:1789135969.140220:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:2.0:1789135969.140228:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c449ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+62:11660:x1876044644684416:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135969.140241:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135969.140268:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3370 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08adb expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.140309:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.140343:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.140356:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.140473:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3370 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 64 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.140492:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 63 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.140502:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:2.0:1789135969.140505:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135969.140509:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5800, rc 0) 00000100:00100000:2.0:1789135969.140557:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c449ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+63:11660:x1876044644684416:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 330us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.140564:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:0.0:1789135969.146258:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135969.146668:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644684672 00000100:00100000:1.0:1789135969.146680:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644684672 00000100:00100000:1.0:1789135969.146746:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:1.0:1789135969.146758:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+63:11660:x1876044644684672:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.146846:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.146896:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.146909:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135969.147088:0:8299:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1789135969.147099:0:8299:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417266243932ns, next at 418266241394ns, rc = 0 00000004:00010000:1.0:1789135969.147150:0:8299:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000017dec604 reply state 000000003733efc6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.147164:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.147170:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:1.0:1789135969.147172:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789135969.147177:0:8299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135969.147275:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4498b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+65:11660:x1876044644684672:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 518us (1026us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789135969.147302:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:3.0:1789135969.149470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.149603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644684800 00000100:00100000:0.0:1789135969.149614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644684800 00000100:00100000:0.0:1789135969.149672:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:0.0:1789135969.149682:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+65:11660:x1876044644684800:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.149706:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.149726:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ae2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.149793:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.149807:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.149833:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:0.0:1789135969.149836:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135969.149840:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fa00, rc 0) 00000100:00100000:0.0:1789135969.150275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+66:11660:x1876044644684800:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 592us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.150293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:0.0:1789135969.154988:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135969.155138:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644684928 00000100:00100000:2.0:1789135969.155149:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644684928 00000100:00100000:2.0:1789135969.155271:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:2.0:1789135969.155282:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644684928:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789135969.155470:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135969.156122:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4499e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2392:x1876044644684928:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 839us (1141us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789135969.156132:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:0.0:1789135969.160391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135969.161628:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644685184 00000100:00100000:2.0:1789135969.161641:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644685184 00000100:00100000:2.0:1789135969.161714:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:2.0:1789135969.161725:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+66:11660:x1876044644685184:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135969.162650:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+67:11660:x1876044644685184:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 921us (2262us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789135969.162663:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1789135969.165523:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135969.165637:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644685440 00000100:00100000:2.0:1789135969.165647:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644685440 00000100:00100000:2.0:1789135969.165706:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:2.0:1789135969.165716:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+67:11660:x1876044644685440:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135969.165894:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+67:11660:x1876044644685440:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 178us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.165902:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:0.0:1789135969.170410:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135969.170512:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644685568 00000100:00100000:1.0:1789135969.170522:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644685568 00000100:00100000:1.0:1789135969.170586:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:1.0:1789135969.170597:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+67:11660:x1876044644685568:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.170617:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135969.170637:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de338c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ae9 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.170705:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3393 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.170721:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.170733:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135969.170780:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135969.170804:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3393 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.170842:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de338c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae9 expref: 69 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.170953:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3393 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae9 expref: 68 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.170984:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:1.0:1789135969.170987:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135969.170992:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879200, rc 0) 00000100:00100000:0.0:1789135969.173317:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+68:11660:x1876044644685568:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2705us (2901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.173332:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:1.0:1789135969.179961:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.180434:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644685696 00000100:00100000:0.0:1789135969.180446:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644685696 00000100:00100000:0.0:1789135969.180510:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:0.0:1789135969.180520:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644685696:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.180541:0:8536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.180563:0:8536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08af0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135969.180590:0:8536:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c60, blocks: 0x0 00010000:00010000:0.0:1789135969.180611:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1789135969.180616:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.180626:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 10 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.180646:0:8536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 10 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.180659:0:8536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3ee00, rc 0) 00000100:00100000:0.0:1789135969.180836:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2391:x1876044644685696:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 309us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.180893:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:3.0:1789135969.188911:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.189308:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644685952 00000100:00100000:0.0:1789135969.189319:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644685952 00000100:00100000:0.0:1789135969.189386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:0.0:1789135969.189398:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:11660:x1876044644685952:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135969.189504:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:11660:x1876044644685952:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 108us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.189512:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:1.0:1789135969.196679:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.196778:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686080 00000100:00100000:3.0:1789135969.196789:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686080 00000100:00100000:3.0:1789135969.196897:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1789135969.196922:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+10:11660:x1876044644686080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135969.196943:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135969.196965:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08af7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.196998:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.197008:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135969.197012:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135969.197018:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.197062:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.197077:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.197092:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0386940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666793984:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135969.197203:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c3c1a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789135969.200760:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0386940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666793984:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135969.200799:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.200840:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf200, rc 0) 00000100:00100000:3.0:1789135969.200945:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+11:11660:x1876044644686080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 4024us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.200955:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1789135969.211390:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.211496:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686208 00000100:00100000:0.0:1789135969.211506:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686208 00010000:00010000:0.0:1789135969.211549:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.211590:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:0.0:1789135969.211601:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2392:x1876044644686208:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135969.211618:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135969.211638:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.211653:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.211678:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de339a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af0 expref: 11 pid: 8536 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.211713:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.211717:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.211726:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.211736:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.211774:0:8446:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.211790:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8446:1876044666794112:192.168.201.31@tcp:105: 00000100:00100000:0.0:1789135969.211937:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135969.234002:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8446:1876044666794112:192.168.201.31@tcp:105: 00010000:00010000:0.0:1789135969.234052:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135969.234115:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2392:x1876044644686208:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 22514us (22734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.234126:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:2.0:1789135969.235781:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.235926:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686336 00000100:00100000:0.0:1789135969.235934:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686336 00002000:00100000:0.0:1789135969.235985:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90a7ff5d6580 x1876044644686336/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:400/0 lens 504/0 e 0 to 0 dl 1789135980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135969.235996:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7ff5d6580 with x1876044644686336 ext(0->12) 00002000:00010000:0.0:1789135969.236002:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a7ff5d6580 00000100:00100000:0.0:1789135969.236063:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1789135969.236073:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2391:x1876044644686336:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789135969.238121:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+12:2391:x1876044644686336:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 2039us (2338us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789135969.238136:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00002000:00100000:0.0:1789135969.238148:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90a7ff5d6580 x1876044644686336/t4294967309(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:400/0 lens 504/448 e 0 to 0 dl 1789135980 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135969.238159:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7ff5d6580 with x1876044644686336 ext(0->12) 00002000:00010000:0.0:1789135969.238165:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a7ff5d6580 00000100:00100000:1.0:1789135969.250013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135969.250126:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686464 00000100:00100000:2.0:1789135969.250137:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686464 00000100:00100000:2.0:1789135969.250204:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:2.0:1789135969.250215:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+68:11660:x1876044644686464:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789135969.252700:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789135969.252722:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789135969.252766:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789135969.252796:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7d1b449c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789135969.252802:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7ceab6a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7ceab36c0 00000020:00080000:2.0:1789135969.252805:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7ceab6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c44cce00 00000004:00080000:2.0:1789135969.252929:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789135969.252953:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7fa68b300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789135969.252956:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7ceab6f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7fa68be40 00000020:00080000:2.0:1789135969.252959:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7ceab6200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a7c12e6600 00000020:00080000:2.0:1789135969.252986:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789135969.253057:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789135969.253197:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:11660:x1876044644686464:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 2980us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.253207:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:0.0:1789135969.253564:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666794240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789135969.253623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135969.253659:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789135969.253665:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666794368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789135969.253687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135969.253717:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666794240 00000100:00100000:0.0:1789135969.253724:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666794240 00000100:00100000:0.0:1789135969.253760:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666794368 00000100:00100000:0.0:1789135969.253764:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666794368 00000100:00100000:0.0:1789135969.253784:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789135969.253791:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666794240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789135969.253813:0:8536:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00000100:00100000:3.0:1789135969.255131:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666794496:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135969.255185:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.255253:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666794496 00000100:00100000:3.0:1789135969.255259:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666794496 00000100:00100000:3.0:1789135969.255292:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135969.255300:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666794368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789135969.255431:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789135969.255435:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789135968 00002000:00010000:3.0:1789135969.255438:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789135969.255440:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789135968 -> 1789135968 00002000:00010000:3.0:1789135969.255442:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789135969.255481:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3640:x1876044666794368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (1793us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789135969.255488:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789135969.255505:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789135969.255510:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3638:x1876044666794496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789135969.255523:0:8429:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1789135969.255546:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa40c5f, atime: 0x6aa40c5f, ctime: 0x6aa40c5f, blocks: 0x8 00010000:00010000:3.0:1789135969.255554:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.255592:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:3.0:1789135969.255596:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135969.255603:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.255620:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.255631:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.255638:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.255656:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135969.255765:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3638:x1876044666794496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 254us (579us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789135969.255772:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789135969.256015:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7ff6b03c0/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789135969.256022:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666794496:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789135969.256349:0:8536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.256367:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.256387:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789135969.256391:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135969.256396:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.256428:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.256442:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 11 pid: 8432 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.256456:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8536:1876044666794624:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135969.256539:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc300 going to sleep for 11 seconds 00000004:00080000:0.0:1789135969.256567:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7d0387840/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789135969.256572:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666794368:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1789135969.256665:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256675:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256683:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256690:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.256694:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256703:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256719:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135969.256723:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.256727:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256733:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de30a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256764:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256770:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256776:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256781:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.256783:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256789:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256796:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90a7e0aa7900) 00010000:00010000:1.0:1789135969.256799:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.256801:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256806:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de314e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256830:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256835:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256840:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256852:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.256895:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256901:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256910:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135969.256912:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.256915:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256920:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f000/0x559c8745c6de31cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256931:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256936:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256941:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256946:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.256949:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256955:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256974:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135969.256976:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.256979:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.256986:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de31ef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257004:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257011:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257016:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257021:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.257024:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257030:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257038:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135969.257041:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135969.257054:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257061:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de32c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257082:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257089:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257095:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257100:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135969.257103:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257109:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257117:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:1.0:1789135969.257120:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789135969.257123:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257128:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de337e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257147:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135969.257153:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257161:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135969.257163:0:13980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257178:0:13980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257191:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257197:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d9075d/0x559c8745c6de33a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.257213:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135969.257215:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135969.257217:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135969.263534:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000001:00080000:0.0:1789135969.263938:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789135969.263950:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789135969.264130:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686592 00000100:00100000:3.0:1789135969.264139:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686592 00000100:00100000:3.0:1789135969.264195:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:3.0:1789135969.264205:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+12:2391:x1876044644686592:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789135969.265755:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1789135969.265768:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789135969.265994:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644686592:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 1785us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.266017:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1789135969.275360:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.275672:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686720 00000100:00100000:3.0:1789135969.275681:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686720 00010000:00010000:3.0:1789135969.275729:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 7 pid: 8432 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.275778:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:3.0:1789135969.275788:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644686720:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135969.275803:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135969.275808:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 7 pid: 8432 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.275833:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 7 pid: 8432 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.275892:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135969.275897:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135969.275903:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.275912:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.275931:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135969.275979:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644686720:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 192us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.276002:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 87 00010000:00010000:0.0:1789135969.276610:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030cf245d/0x559c8745c6de315c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a4f expref: 6 pid: 8432 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.276627:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8536:1876044666794624:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135969.276649:0:8536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.276671:0:8536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.276677:0:8536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.276687:0:8536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.276695:0:8536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.276720:0:8536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789135969.276947:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44cad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666794240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23155us (23323us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789135969.276955:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789135969.277075:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789135969.277083:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.277092:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ee00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135969.277097:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.277106:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.277133:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.277140:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdafb6d/0x559c8745c6de33af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.277156:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135969.277158:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135969.277159:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135969.277291:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789135969.277298:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1789135969.277314:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7d0387840, transno 4294967310 00000100:00100000:2.0:1789135969.277335:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90a7d0386940 x1876044666794240/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789135985 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789135969.277346:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7d0386940/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789135969.277350:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666794240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789135969.282412:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135969.282501:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644686976 00000100:00100000:1.0:1789135969.282510:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644686976 00000100:00100000:1.0:1789135969.282575:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:1.0:1789135969.282585:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11660:x1876044644686976:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135969.282640:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135969.282669:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3393 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae9 expref: 16 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.282688:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:1.0:1789135969.282695:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135969.282723:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.282738:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.282748:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135969.282926:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e32a154f reply state 00000000a8880bac transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.282940:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.282946:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:1.0:1789135969.282949:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135969.282952:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135969.283063:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+17:11660:x1876044644686976:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 478us (659us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789135969.283070:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:2.0:1789135969.287931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.288024:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644687104 00000100:00100000:0.0:1789135969.288054:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644687104 00000100:00100000:0.0:1789135969.288110:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:0.0:1789135969.288120:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644687104:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789135969.288265:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789135969.288269:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789135968 -> 1789135968 00002000:00010000:0.0:1789135969.288271:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789135967 00002000:00010000:0.0:1789135969.288274:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789135968 -> 1789135968 00002000:00010000:0.0:1789135969.288276:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789135969.288365:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2389:x1876044644687104:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 247us (446us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789135969.288373:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1789135969.307836:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.308094:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644687360 00000100:00100000:0.0:1789135969.308104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644687360 00000100:00100000:0.0:1789135969.308169:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:0.0:1789135969.308181:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+17:11660:x1876044644687360:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.308253:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.308271:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 17 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.308294:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.308330:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 17 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.308344:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 17 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.308359:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666794752:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135969.308452:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.313679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.314965:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644687488 00000100:00100000:3.0:1789135969.314979:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644687488 00010000:00010000:3.0:1789135969.315028:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 18 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.315097:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:3.0:1789135969.315108:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+18:2391:x1876044644687488:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135969.315126:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135969.315133:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 18 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.315148:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 18 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.315173:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:3.0:1789135969.315179:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.315190:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.315198:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.315218:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135969.315767:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+18:2391:x1876044644687488:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 657us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.315793:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 88 00010000:00010000:0.0:1789135969.316494:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3377 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08adb expref: 17 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.316515:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666794752:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135969.316545:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316554:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316560:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316600:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316607:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316614:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316620:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135969.316625:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316632:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316645:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:0.0:1789135969.316648:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789135969.316652:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.316659:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.316742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11660:x1876044644687360:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 8562us (8927us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789135969.316751:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:3.0:1789135969.325314:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.325637:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644687616 00000100:00100000:0.0:1789135969.325648:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644687616 00000100:00100000:0.0:1789135969.325702:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:0.0:1789135969.325713:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644687616:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.325759:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.325782:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.325791:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135969.325796:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135969.325800:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.325848:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.325889:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 7 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.325904:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876044666794880:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135969.326002:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135969.328439:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8432:1876044666794880:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135969.328474:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.329256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.330274:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644687744 00000100:00100000:0.0:1789135969.330355:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644687744 00010000:00010000:0.0:1789135969.330399:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.330496:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:0.0:1789135969.330506:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644687744:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135969.330526:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135969.330547:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.330560:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.330582:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e917d6/0x559c8745c6de33a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08af7 expref: 8 pid: 8430 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.330598:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135969.330602:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789135969.330608:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.330635:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.330671:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135969.330727:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644687744:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 222us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.330734:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 89 00010000:00010000:1.0:1789135969.330797:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330807:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330837:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330846:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330880:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330899:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789135969.330903:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330914:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330926:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.330934:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de33c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.330989:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644687616:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 5277us (5685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.330996:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:2.0:1789135969.341883:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.342190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644688000 00000100:00100000:0.0:1789135969.342199:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644688000 00000100:00100000:0.0:1789135969.342255:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00100000:0.0:1789135969.342265:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+16:11660:x1876044644688000:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.342433:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.342450:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.342460:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.342496:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.342509:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.342523:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666795008:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135969.344582:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.375901:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135969.375993:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644688128 00000100:00100000:1.0:1789135969.376002:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644688128 00010000:00010000:1.0:1789135969.376088:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 17 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.376135:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:1.0:1789135969.376146:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+17:2391:x1876044644688128:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135969.376161:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135969.376182:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 17 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.376196:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 17 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.376222:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:1.0:1789135969.376227:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.376237:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.376246:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.376253:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135969.376273:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135969.376342:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+17:2391:x1876044644688128:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 197us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.376351:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 90 00010000:00010000:0.0:1789135969.376620:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de32ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08aa3 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.376636:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666795008:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135969.376657:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376666:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376672:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376836:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376849:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376909:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376941:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.376956:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.376971:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666795136:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135969.377065:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.390013:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.390197:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644688256 00000100:00100000:3.0:1789135969.390206:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644688256 00010000:00010000:3.0:1789135969.390251:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 17 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.390313:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:3.0:1789135969.390323:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+17:2391:x1876044644688256:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135969.390338:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135969.390345:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 17 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.390359:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 17 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.390385:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:3.0:1789135969.390391:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.390402:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.390411:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.390432:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135969.390506:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+17:2391:x1876044644688256:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 183us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.390515:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 91 00010000:00010000:0.0:1789135969.391654:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3385 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ae2 expref: 16 pid: 6516 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.391673:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666795136:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135969.391694:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.391703:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.391710:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135969.391804:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1789135969.391950:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1789135969.391980:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789135969.392201:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666795264:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789135969.392250:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135969.392288:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450600 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.392393:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666795264 00000100:00100000:2.0:1789135969.392399:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666795264 00000100:00100000:2.0:1789135969.392441:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789135969.392450:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1876044666795264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789135969.392530:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1876044666795264:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.392537:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789135969.392608:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666795264:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789135969.392702:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1789135969.392737:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666795392:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789135969.392778:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.392804:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135969.392881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666795392 00000100:00100000:1.0:1789135969.392885:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666795392 00000100:00100000:1.0:1789135969.392916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789135969.392923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6515:x1876044666795392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789135969.393018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6515:x1876044666795392:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (238us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789135969.393057:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789135969.393258:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d3c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1876044666795392:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789135969.393299:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393307:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393313:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393319:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135969.393323:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393332:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393347:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:3.0:1789135969.393350:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135969.393354:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393371:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de33d2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393395:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393402:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393408:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393413:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135969.393417:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393423:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393431:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135969.393433:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789135969.393440:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393450:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393458:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.393495:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.393507:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e821c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666795520:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789135969.393574:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789135969.404317:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.404393:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644688384 00000100:00100000:0.0:1789135969.404402:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644688384 00000100:00100000:0.0:1789135969.404466:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1789135969.404476:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11659:x1876044644688384:12345-192.168.201.31@tcp:49:lfs.0 00000100:00100000:0.0:1789135969.404615:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:11659:x1876044644688384:12345-192.168.201.31@tcp:49:lfs.0 Request processed in 140us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.404623:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:3.0:1789135969.405213:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e821c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666795520:192.168.201.31@tcp:105: 00010000:00010000:3.0:1789135969.405239:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405250:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de3315 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405295:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405311:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405322:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405333:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405339:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405347:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405371:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135969.405375:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405383:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405395:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135969.405398:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135969.405402:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405408:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405419:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405425:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405431:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405436:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135969.405439:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405445:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405464:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135969.405467:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135969.405471:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.405476:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de33cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.405676:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11660:x1876044644688000:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 63410us (63822us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1789135969.405684:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 139 00000020:00080000:3.0:1789135969.405688:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789135969.408372:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.410250:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644688640 00000100:00100000:3.0:1789135969.410265:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644688640 00000100:00100000:3.0:1789135969.410345:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:3.0:1789135969.410356:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11659:x1876044644688640:12345-192.168.201.31@tcp:58:lfs.0 00000040:00080000:3.0:1789135969.410534:0:14529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789135969.410635:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11659:x1876044644688640:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 280us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.410642:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:2.0:1789135969.415565:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.415655:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644688896 00000100:00100000:0.0:1789135969.415677:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644688896 00000100:00100000:0.0:1789135969.415728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1789135969.415737:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:11660:x1876044644688896:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789135969.416003:0:6519:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789135969.416051:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789135969.416105:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.416121:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.416134:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.416143:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.416150:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.416156:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.416174:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:1.0:1789135969.416202:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:0.0:1789135969.416249:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+21:11660:x1876044644688896:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 513us (693us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789135969.416257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000020:00080000:0.0:1789135969.416262:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789135969.416336:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135969.416363:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789135969.416370:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789135969.416380:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135969.416388:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.416396:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fa00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135969.416400:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.416419:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.416431:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:3.0:1789135969.416435:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135969.416439:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.416446:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de33e0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.416458:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135969.416460:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135969.416461:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135969.416479:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666795648:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135969.416781:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c381e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789135969.422118:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666795648:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135969.423098:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.423178:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644689024 00000100:00100000:3.0:1789135969.423185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644689024 00000100:00100000:3.0:1789135969.423244:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:3.0:1789135969.423255:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+21:11661:x1876044644689024:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789135969.423291:0:6516:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789135969.423401:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+21:11661:x1876044644689024:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 147us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.423408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:2.0:1789135969.427023:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.429470:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644689280 00000100:00100000:0.0:1789135969.429485:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644689280 00000100:00100000:0.0:1789135969.429565:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:0.0:1789135969.429590:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:11661:x1876044644689280:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135969.429615:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135969.429636:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de33e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08afe expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.429741:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de33ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.429756:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de33ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.429768:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de33ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135969.429780:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135969.429942:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de33e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08afe expref: 24 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.429961:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de33ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08afe expref: 23 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.429970:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135969.429973:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135969.429977:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e200, rc 0) 00000100:00100000:0.0:1789135969.430062:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+23:11661:x1876044644689280:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 474us (3049us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789135969.430070:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:2.0:1789135969.453214:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.453319:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644689536 00000100:00100000:3.0:1789135969.453329:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644689536 00000100:00100000:3.0:1789135969.453406:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:3.0:1789135969.453415:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+23:11661:x1876044644689536:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789135969.453507:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453540:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453552:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453730:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453739:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453746:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453751:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135969.453756:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453764:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453777:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135969.453780:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789135969.453785:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.453791:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de33fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135969.453946:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+24:11661:x1876044644689536:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 530us (740us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789135969.453959:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 143 00000040:00080000:1.0:1789135969.454113:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135969.454118:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135969.454731:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789135969.454739:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135969.459641:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.459741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644689792 00000100:00100000:0.0:1789135969.459751:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644689792 00000100:00100000:0.0:1789135969.459828:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:0.0:1789135969.459839:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+24:11661:x1876044644689792:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789135969.460112:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+25:11661:x1876044644689792:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 274us (482us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789135969.460120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789135969.485406:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135969.485604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644689920 00000100:00100000:3.0:1789135969.485614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644689920 00000100:00100000:3.0:1789135969.485675:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:3.0:1789135969.485686:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+25:11663:x1876044644689920:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135969.485711:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135969.485732:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de3403 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b05 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.485793:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.485807:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135969.487594:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495476:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495501:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495515:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495607:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495621:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 26 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495630:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495669:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 26 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.495688:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 26 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135969.495702:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666795776:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135969.495834:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c6319600 going to sleep for 11 seconds 00000100:00100000:3.0:1789135969.511015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.511124:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644690176 00000100:00100000:0.0:1789135969.511133:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644690176 00000100:00100000:0.0:1789135969.511197:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:0.0:1789135969.511208:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+27:6165:x1876044644690176:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789135969.511465:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:6165:x1876044644690176:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 258us (460us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789135969.511473:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00010000:00010000:1.0:1789135969.512112:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135969.512307:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666795776:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135969.512437:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135969.516916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135969.517149:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644690304 00000100:00100000:0.0:1789135969.517160:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644690304 00010000:00010000:0.0:1789135969.517201:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 28 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135969.517245:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:0.0:1789135969.517254:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+28:2391:x1876044644690304:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135969.517286:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135969.517293:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 28 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.517307:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 28 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.517361:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de3307 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08abf expref: 28 pid: 14528 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.517377:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135969.517383:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.517393:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.517401:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135969.517671:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135969.517801:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517810:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135969.517895:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789135969.517900:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135969.517921:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517934:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517943:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517949:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517956:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517962:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135969.517966:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517985:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.517995:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:2.0:1789135969.517997:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135969.518001:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518006:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de340a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518016:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518021:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518026:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518030:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135969.518033:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518049:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518056:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90a7fa7c3300) 00010000:00010000:2.0:1789135969.518059:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135969.518061:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518077:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518116:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de3403 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b05 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518130:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b05 expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135969.518136:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:2.0:1789135969.518139:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135969.518141:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4000, rc 0) 00000100:00100000:0.0:1789135969.518257:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+27:2391:x1876044644690304:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 1003us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135969.518266:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:2.0:1789135969.520227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+26:11663:x1876044644689920:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 34532us (34822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135969.520239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:1.0:1789135969.640386:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135969.640417:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666795904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135969.640512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135969.640592:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666795904 00000100:00100000:1.0:1789135969.640599:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666795904 00000100:00100000:1.0:1789135969.640662:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135969.640672:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666795904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789135969.640698:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1789135969.640747:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666795904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135969.640755:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135969.640804:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666795904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135969.641842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789135969.641912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135969.642051:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796032 00000100:00100000:3.0:1789135969.642059:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796032 00000100:00100000:3.0:1789135969.642107:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789135969.642115:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666796032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135969.642133:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1789135969.642182:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666796032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135969.642189:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789135969.642316:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135970.153406:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666796160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135970.153491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135970.153732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796160 00000100:00100000:2.0:1789135970.153740:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796160 00000100:00100000:2.0:1789135970.153797:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789135970.153806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666796160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789135970.153843:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789135970.153934:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666796160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135970.153942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789135970.154042:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666796160:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789135970.480851:0:14973:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789135970.480886:0:14973:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789135970.480926:0:14973:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789135970.480932:0:14973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789135970.536120:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135970.702038:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135970.702152:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644690560 00000100:00100000:0.0:1789135970.702160:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644690560 00000100:00100000:0.0:1789135970.702213:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 145 00000100:00100000:0.0:1789135970.702223:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+26:11686:x1876044644690560:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135970.702248:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135970.702268:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de341f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b0c expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135970.702374:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3426 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135970.702389:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135970.702400:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3426 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135970.702409:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789135970.702502:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de341f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b0c expref: 29 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135970.702516:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3426 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b0c expref: 28 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135970.702522:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:0.0:1789135970.702524:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789135970.702527:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f200, rc 0) 00000100:00100000:0.0:1789135970.702578:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+28:11686:x1876044644690560:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 357us (561us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789135970.702583:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 145 00000100:00100000:1.0:1789135970.705030:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135970.705123:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644690688 00000100:00100000:3.0:1789135970.705133:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644690688 00000100:00100000:3.0:1789135970.705193:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:3.0:1789135970.705202:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+28:11686:x1876044644690688:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1789135970.705263:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705280:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705292:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705337:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705343:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705349:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705354:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135970.705358:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705366:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705387:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:3.0:1789135970.705390:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789135970.705395:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.705400:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de3434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135970.705504:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+28:11686:x1876044644690688:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 302us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135970.705512:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:1.0:1789135970.808276:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135970.808330:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135970.808367:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135970.808402:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135970.808418:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135970.808439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135970.808473:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691328 00000100:00100000:1.0:1789135970.808482:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691328 00000100:00100000:1.0:1789135970.808540:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644690944 00000100:00100000:1.0:1789135970.808544:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644690944 00000100:00100000:1.0:1789135970.808564:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691456 00000100:00100000:1.0:1789135970.808566:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691456 00000100:00100000:1.0:1789135970.808591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 370 00000100:00100000:1.0:1789135970.808601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644691328:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135970.808691:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644691328:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135970.808699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 370 00000100:00100000:1.0:1789135970.808720:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 371 00000100:00100000:1.0:1789135970.808728:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644690944:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135970.808753:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644690944:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135970.808778:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 371 00000100:00100000:1.0:1789135970.808792:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 372 00000100:00100000:1.0:1789135970.808798:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644691456:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135970.808824:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644691456:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135970.808830:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 372 00000100:00080000:1.0:1789135970.808846:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789135970.808850:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135970.809234:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644690816 00000100:00100000:3.0:1789135970.809239:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644690816 00000100:00100000:3.0:1789135970.809284:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 459 00000100:00100000:3.0:1789135970.809291:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644690816:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135970.809335:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644690816:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 44us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135970.809342:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 459 00000100:00100000:3.0:1789135970.809372:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691072 00000100:00100000:3.0:1789135970.809375:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691072 00000100:00100000:3.0:1789135970.809400:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691200 00000100:00100000:3.0:1789135970.809403:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691200 00000100:00100000:3.0:1789135970.809421:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:3.0:1789135970.809428:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644691072:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135970.809456:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644691072:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135970.809462:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:3.0:1789135970.809483:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:3.0:1789135970.809490:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644691200:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135970.809517:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644691200:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135970.809523:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00080000:1.0:1789135970.809881:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135970.904438:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135970.904529:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691584 00000100:00100000:3.0:1789135970.904539:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691584 00000100:00100000:3.0:1789135970.904595:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:3.0:1789135970.904604:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644691584:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:3.0:1789135970.904744:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135970.904769:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c7d66cf/0x559c8745c6de343b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b13 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135970.904796:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa40c60, atime: 0x6aa40c5f, ctime: 0x6aa40c60, blocks: 0x8 00010000:00010000:3.0:1789135970.904822:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1789135970.904828:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135970.904838:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c7d66cf/0x559c8745c6de343b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b13 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.904910:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c7d66cf/0x559c8745c6de343b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b13 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135970.904925:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caee00, rc 0) 00000100:00100000:3.0:1789135970.904992:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644691584:12345-192.168.201.31@tcp:101:cat.0 Request processed in 388us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135970.904999:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:1.0:1789135970.908822:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135970.908951:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691712 00000100:00100000:0.0:1789135970.908962:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691712 00002000:00100000:0.0:1789135970.909023:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff90a6c451b0c0 x1876044644691712/t0(0) o3->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:401/0 lens 488/0 e 0 to 0 dl 1789135981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135970.909035:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c451b0c0 with x1876044644691712 ext(0->4095) 00002000:00010000:0.0:1789135970.909054:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c451b0c0 00000100:00100000:0.0:1789135970.909089:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:0.0:1789135970.909100:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644691712:12345-192.168.201.31@tcp:3:cat.0 00000100:00100000:0.0:1789135970.909295:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644691712:12345-192.168.201.31@tcp:3:cat.0 Request processed in 195us (481us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789135970.909304:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00002000:00100000:0.0:1789135970.909323:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff90a6c451b0c0 x1876044644691712/t0(0) o3->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:401/0 lens 488/4536 e 0 to 0 dl 1789135981 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135970.909333:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c451b0c0 with x1876044644691712 ext(0->4095) 00002000:00010000:0.0:1789135970.909336:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c451b0c0 00010000:00010000:3.0:1789135971.561339:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789135972.585118:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789135973.544174:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135973.544189:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135973.544215:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789135973.544228:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789135973.608157:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135973.738395:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135973.738440:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666796288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135973.738566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135973.738670:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796288 00000100:00100000:0.0:1789135973.738682:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796288 00000100:00100000:0.0:1789135973.738748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789135973.738760:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666796288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135973.738808:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789135973.738905:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666796288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135973.738913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789135973.738984:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666796288:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789135973.743643:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789135974.248334:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666796672:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.248457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.248553:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666797184:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.248585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.248611:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666797696:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.248636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.248667:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789135974.248674:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666796544:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.248699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.248719:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f668a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666797056:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.248771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.248792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666797568:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.248813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.248846:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796672 00000100:00100000:0.0:1789135974.248895:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796672 00000100:00100000:0.0:1789135974.248968:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789135974.248980:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666796672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249048:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666796672:12345-0@lo:400:kworker.0 Request processed in 70us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.249056:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789135974.249085:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797184 00000100:00100000:0.0:1789135974.249090:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797184 00000100:00100000:0.0:1789135974.249132:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797696 00000100:00100000:0.0:1789135974.249135:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797696 00000100:00100000:0.0:1789135974.249150:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796544 00000100:00100000:0.0:1789135974.249162:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796544 00000100:00100000:0.0:1789135974.249177:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797056 00000100:00100000:0.0:1789135974.249179:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797056 00000100:00100000:0.0:1789135974.249192:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797568 00000100:00100000:0.0:1789135974.249194:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797568 00000100:00100000:0.0:1789135974.249208:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789135974.249214:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249246:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666797184:12345-0@lo:400:kworker.0 Request processed in 33us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.249252:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789135974.249265:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789135974.249270:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666797696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249295:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2313840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666797696:12345-0@lo:400:kworker.0 Request processed in 25us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.249300:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789135974.249310:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789135974.249315:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666796544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249341:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2da5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666796544:12345-0@lo:400:kworker.0 Request processed in 26us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.249347:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789135974.249358:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789135974.249363:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666797056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249388:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666797056:12345-0@lo:400:kworker.0 Request processed in 26us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.249394:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789135974.249405:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789135974.249411:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4778f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249447:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4778f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666797568:12345-0@lo:400:kworker.0 Request processed in 36us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.249455:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:0.0:1789135974.249489:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135974.249494:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789135974.249533:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666796544:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249545:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f668a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666797056:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249555:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666797568:0@lo:400:kworker.0 00000100:00100000:0.0:1789135974.249564:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666796672:0@lo:400:kworker.0 00010000:00080000:0.0:1789135974.249576:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4620f00 x1876044666797184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135974.249587:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666797184:0@lo:400:kworker.0 00010000:00080000:0.0:1789135974.249598:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3fe0b40 x1876044666797696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135974.249607:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666797696:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250239:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666796800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250336:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666797312:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250381:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4465680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666797824:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250605:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789135974.250616:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666796416:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250654:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250681:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666796928:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250726:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666797440:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250783:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666797952:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250801:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135974.250834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796800 00000100:00100000:1.0:1789135974.250840:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796800 00000100:00100000:1.0:1789135974.250915:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789135974.250924:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666796800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.250987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666796800:12345-0@lo:400:kworker.0 Request processed in 64us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135974.250994:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789135974.251021:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797312 00000100:00100000:1.0:1789135974.251024:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797312 00000100:00100000:1.0:1789135974.251059:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797824 00000100:00100000:1.0:1789135974.251062:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797824 00000100:00100000:1.0:1789135974.251075:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797440 00000100:00100000:1.0:1789135974.251077:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797440 00000100:00100000:1.0:1789135974.251089:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666797952 00000100:00100000:1.0:1789135974.251091:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666797952 00000100:00100000:1.0:1789135974.251104:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135974.251110:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666797312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.251144:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666797312:12345-0@lo:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135974.251151:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789135974.251162:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789135974.251168:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666797824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.251197:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666797824:12345-0@lo:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135974.251203:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789135974.251554:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c477b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666798080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135974.251595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.252044:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666798208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135974.252080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135974.252265:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798080 00000100:00100000:2.0:1789135974.252272:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798080 00000100:00100000:2.0:1789135974.252315:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798208 00000100:00100000:2.0:1789135974.252318:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798208 00000100:00100000:2.0:1789135974.252349:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789135974.252355:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666798080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135974.252383:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135974.252444:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666798080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135974.252451:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789135974.252465:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789135974.252471:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4779a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666798208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789135974.252480:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135974.252508:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4779a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666798208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135974.252525:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789135974.253096:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789135974.253106:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1789135974.253136:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7c86dc780, transno 4294967302 00000004:00080000:0.0:1789135974.253157:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1789135974.253183:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7ff6b03c0, transno 4294967305 00000100:00100000:0.0:1789135974.253212:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666798208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135974.259750:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789135974.259817:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666797440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135974.259984:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666797440:12345-0@lo:400:kworker.0 Request processed in 217us (9218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135974.259995:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789135974.260046:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789135974.260056:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666797952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135974.260097:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666797952:12345-0@lo:400:kworker.0 Request processed in 43us (9294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135974.260104:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789135974.260183:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c477b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666798080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135974.263592:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796416 00000100:00100000:1.0:1789135974.263614:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796416 00000100:00100000:1.0:1789135974.263707:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789135974.263719:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666796416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.263874:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c389f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666796416:12345-0@lo:400:kworker.0 Request processed in 139us (13200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135974.263883:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789135974.263938:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666796928 00000100:00100000:1.0:1789135974.263944:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666796928 00000100:00100000:1.0:1789135974.263984:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789135974.263991:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666796928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264032:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666796928:12345-0@lo:400:kworker.0 Request processed in 42us (13323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135974.264039:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1789135974.264066:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135974.264073:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135974.264114:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666796416:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264131:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666796928:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264147:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666797440:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264161:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666797952:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264176:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44c8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666796800:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264190:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666797312:0@lo:400:kworker.0 00000100:00100000:1.0:1789135974.264204:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4465680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666797824:0@lo:400:kworker.0 00000001:00080000:0.0:1789135974.265068:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789135974.265108:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7fa68b900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789135974.265115:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7f6864f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7fa68be40 00000020:00080000:0.0:1789135974.265119:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7f6864700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c3f53800 00000020:00080000:0.0:1789135974.265151:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1789135974.265181:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135974.265202:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135974.265210:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135974.265217:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135974.265223:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135974.265232:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135974.265253:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90a7fa7c3c00) 00010000:00010000:0.0:1789135974.265257:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135974.265263:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135974.265272:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de33b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789135974.265319:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789135974.265441:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1789135974.638914:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135974.760443:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c451b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666798336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135974.760522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135974.762156:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798336 00000001:00080000:1.0:1789135974.763404:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1789135974.763418:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1789135974.763556:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798336 00000100:00100000:2.0:1789135974.763609:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789135974.763617:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666798336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789135974.763870:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789135974.763955:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666798336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 329us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135974.763965:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789135974.764089:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c451b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666798336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135974.765923:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666798464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135974.765995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135974.767578:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798464 00000100:00100000:0.0:1789135974.767591:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798464 00000100:00100000:0.0:1789135974.767645:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789135974.767655:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666798464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135974.767678:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789135974.767750:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666798464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135974.767757:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789135974.767812:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1789135974.767819:0:3639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7d0386940, transno 4294967311 00000004:00080000:0.0:1789135974.767830:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1789135974.767872:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666798464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135975.273262:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666798592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135975.273327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135975.273512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798592 00000100:00100000:1.0:1789135975.273519:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798592 00000100:00100000:1.0:1789135975.273565:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789135975.273572:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666798592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789135975.273616:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789135975.273671:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666798592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135975.273679:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789135975.273839:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666798592:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789135975.658176:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135975.941397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941443:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941503:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941527:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941580:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135975.941606:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691840 00000100:00100000:3.0:1789135975.941615:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691840 00000100:00100000:3.0:1789135975.941677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 461 00000100:00100000:3.0:1789135975.941687:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644691840:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.941757:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644691840:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.941764:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 461 00000100:00100000:3.0:1789135975.941840:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644691968 00000100:00100000:3.0:1789135975.941845:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644691968 00000100:00100000:3.0:1789135975.942184:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692096 00000100:00100000:3.0:1789135975.942189:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692096 00000100:00100000:3.0:1789135975.942209:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 379 00000100:00100000:3.0:1789135975.942216:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2392:x1876044644691968:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.942249:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2392:x1876044644691968:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 35us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.942256:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 379 00000100:00100000:3.0:1789135975.942267:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692608 00000100:00100000:3.0:1789135975.942270:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692608 00000100:00100000:3.0:1789135975.942285:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692480 00000100:00100000:3.0:1789135975.942287:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692480 00000100:00100000:3.0:1789135975.942300:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 380 00000100:00100000:3.0:1789135975.942306:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644692096:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.942331:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644692096:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.942337:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 380 00000100:00100000:3.0:1789135975.942359:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 381 00000100:00100000:3.0:1789135975.942365:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644692608:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.942389:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644692608:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.942394:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 381 00000100:00100000:3.0:1789135975.942405:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 382 00000100:00100000:3.0:1789135975.942410:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644692480:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.942432:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2392:x1876044644692480:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.942438:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 382 00000100:00100000:3.0:1789135975.942456:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692352 00000100:00100000:3.0:1789135975.942460:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692352 00000100:00100000:3.0:1789135975.942486:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692224 00000100:00100000:3.0:1789135975.942489:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692224 00000100:00100000:3.0:1789135975.942509:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:3.0:1789135975.942515:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644692352:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.942540:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644692352:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.942547:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:3.0:1789135975.942558:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:3.0:1789135975.942563:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644692224:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135975.942583:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644692224:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135975.942589:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00080000:3.0:1789135975.942748:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135975.942752:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135975.942755:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135975.942757:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789135976.680282:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135976.680490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135976.680607:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692736 00000100:00100000:3.0:1789135976.680620:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692736 00000100:00100000:3.0:1789135976.680740:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 147 00000100:00100000:3.0:1789135976.680753:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11347:x1876044644692736:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789135976.680962:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11347:x1876044644692736:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 212us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135976.680971:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 147 00000100:00100000:3.0:1789135976.683572:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135976.683648:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644692864 00000100:00100000:1.0:1789135976.683662:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644692864 00000100:00100000:1.0:1789135976.683740:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:1.0:1789135976.683751:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:11347:x1876044644692864:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789135976.684136:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:11347:x1876044644692864:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 385us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135976.684145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:1.0:1789135976.695444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135976.697264:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693120 00000100:00100000:3.0:1789135976.697283:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693120 00000100:00100000:3.0:1789135976.697375:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1789135976.697387:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+14:11347:x1876044644693120:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789135976.697720:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+15:11347:x1876044644693120:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 334us (2292us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789135976.697729:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1789135977.114125:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135977.114312:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693248 00000100:00100000:3.0:1789135977.114326:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693248 00000100:00100000:3.0:1789135977.114430:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 149 00000100:00100000:3.0:1789135977.114444:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:12145:x1876044644693248:12345-192.168.201.31@tcp:101:lsof.0 00010000:00010000:3.0:1789135977.114475:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135977.114503:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b1a expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135977.114622:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135977.114641:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135977.114659:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135977.114721:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789135977.114725:0:14529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135977.115054:0:14529:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135977.115091:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 7 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135977.115114:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 6 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135977.115124:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:3.0:1789135977.115128:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789135977.115132:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae000, rc 0) 00000100:00100000:3.0:1789135977.115439:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+6:12145:x1876044644693248:12345-192.168.201.31@tcp:101:lsof.0 Request processed in 996us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135977.115449:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 149 00000100:00080000:1.0:1789135977.115841:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135977.704824:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135978.729816:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135978.856233:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c477a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666798720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135978.856378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135978.857276:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798720 00000100:00100000:0.0:1789135978.857290:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798720 00000100:00100000:0.0:1789135978.857375:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789135978.857388:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666798720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135978.857453:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789135978.857547:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666798720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135978.857555:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789135978.859656:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c477a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666798720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135979.369820:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789135979.369847:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666798848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135979.369954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135979.370148:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798848 00000100:00100000:2.0:1789135979.370171:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798848 00000100:00100000:2.0:1789135979.370228:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789135979.370238:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666798848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789135979.370282:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789135979.370325:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666798848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135979.370333:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789135979.370976:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666799232:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.371040:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666799744:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.371077:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666800256:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371096:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.371124:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789135979.371130:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666799104:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.371178:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666799616:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.371220:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666800128:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.371266:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799104 00000100:00100000:3.0:1789135979.371271:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799104 00000100:00100000:3.0:1789135979.371302:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1789135979.371310:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666799104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371348:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666799104:12345-0@lo:400:kworker.0 Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.371355:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1789135979.371383:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799616 00000100:00100000:3.0:1789135979.371387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799616 00000100:00100000:3.0:1789135979.371412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789135979.371418:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666799616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371461:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666799616:12345-0@lo:400:kworker.0 Request processed in 43us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.371468:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789135979.371504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799232 00000100:00100000:3.0:1789135979.371508:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799232 00000100:00100000:3.0:1789135979.371534:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799744 00000100:00100000:3.0:1789135979.371537:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799744 00000100:00100000:3.0:1789135979.371559:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800256 00000100:00100000:3.0:1789135979.371561:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800256 00000100:00100000:3.0:1789135979.371573:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800128 00000100:00100000:3.0:1789135979.371575:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800128 00000100:00100000:3.0:1789135979.371588:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789135979.371593:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666799232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371625:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666799232:12345-0@lo:400:kworker.0 Request processed in 31us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.371631:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789135979.371643:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789135979.371649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666799744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371674:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666799744:12345-0@lo:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.371680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789135979.371691:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789135979.371696:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666800256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371721:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666800256:12345-0@lo:400:kworker.0 Request processed in 25us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.371727:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789135979.371738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789135979.371752:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666800128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371779:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666800128:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.371785:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789135979.371830:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666799104:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371841:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666799616:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371850:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666800128:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371901:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666799232:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.371910:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666799744:0@lo:400:kworker.0 00010000:00080000:3.0:1789135979.371921:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c47e5680 x1876044666800256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135979.371931:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666800256:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373080:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666799360:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373140:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373548:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666799872:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373579:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373602:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666800384:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373675:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789135979.373682:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666798976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789135979.373719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373741:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666799488:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373782:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666800000:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373814:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666800512:0@lo:400:kworker.0 00000100:00100000:1.0:1789135979.373833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135979.373915:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800384 00000100:00100000:1.0:1789135979.373922:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800384 00000100:00100000:1.0:1789135979.373967:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800000 00000100:00100000:1.0:1789135979.373971:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800000 00000100:00100000:1.0:1789135979.373988:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800512 00000100:00100000:1.0:1789135979.373990:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800512 00000100:00100000:1.0:1789135979.374004:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789135979.374013:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666800384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.374089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799360 00000100:00100000:3.0:1789135979.374094:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799360 00000100:00100000:3.0:1789135979.374125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789135979.374132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666799360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.374606:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666799360:12345-0@lo:400:kworker.0 Request processed in 472us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.374615:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789135979.374667:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666798976 00000100:00100000:3.0:1789135979.374672:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666798976 00000100:00100000:3.0:1789135979.374695:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789135979.374701:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666798976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135979.374731:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135979.374763:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4545e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666798976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.374770:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789135979.374895:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666798848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135979.374942:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789135979.374957:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666800000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135979.374992:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666800000:12345-0@lo:400:kworker.0 Request processed in 37us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135979.374998:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789135979.375015:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789135979.375021:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666800512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.375988:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799872 00000100:00100000:3.0:1789135979.375996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799872 00000100:00100000:3.0:1789135979.376036:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666799488 00000100:00100000:3.0:1789135979.376039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666799488 00000100:00100000:3.0:1789135979.376059:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789135979.376066:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666799872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.376116:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666799872:12345-0@lo:400:kworker.0 Request processed in 51us (2537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.376123:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789135979.376136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789135979.376142:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666799488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.376169:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4546940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666799488:12345-0@lo:400:kworker.0 Request processed in 28us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.376174:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:3.0:1789135979.376190:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135979.376195:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135979.376197:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135979.376200:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135979.376275:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666798976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135979.376302:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666799488:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.376311:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666800000:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.376323:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666799360:0@lo:400:kworker.0 00010000:00080000:3.0:1789135979.376353:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2e82940 x1876044666799872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789135995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135979.376364:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2e82940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666799872:0@lo:400:kworker.0 00000100:00100000:0.0:1789135979.376632:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666800512:12345-0@lo:400:kworker.0 Request processed in 1609us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135979.376642:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789135979.376754:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4546d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666800384:12345-0@lo:400:kworker.0 Request processed in 2740us (3112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135979.376761:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789135979.377974:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666800512:0@lo:400:kworker.0 00000100:00100000:3.0:1789135979.377989:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666800384:0@lo:400:kworker.0 00010000:00010000:3.0:1789135979.752556:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135979.880530:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666800640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135979.880607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135979.880946:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789135979.880955:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666800768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135979.881003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135979.881387:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800640 00000100:00100000:3.0:1789135979.881396:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800640 00000100:00100000:3.0:1789135979.881448:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800768 00000100:00100000:3.0:1789135979.881451:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800768 00000100:00100000:3.0:1789135979.881486:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135979.881564:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666800640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135979.881596:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789135979.881649:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666800640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.881657:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789135979.881672:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135979.881679:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666800768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135979.881690:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789135979.881715:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4791a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666800768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135979.881721:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789135979.881769:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666800768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135979.881784:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666800640:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1789135979.883830:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789135979.883843:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789135979.883915:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789135979.883927:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789135980.395202:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666800896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135980.395319:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135980.395463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666800896 00000100:00100000:3.0:1789135980.395472:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666800896 00000100:00100000:3.0:1789135980.395528:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789135980.395538:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666800896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135980.395575:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135980.396097:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666800896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 558us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135980.396106:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789135980.400838:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4790780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666800896:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789135980.776495:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135981.044576:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044649:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044675:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044749:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135981.044777:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693760 00000100:00100000:2.0:1789135981.044797:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693760 00000100:00100000:2.0:1789135981.044881:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693888 00000100:00100000:2.0:1789135981.044885:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693888 00000100:00100000:2.0:1789135981.044909:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:2.0:1789135981.044918:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644693760:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135981.044994:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644693760:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 76us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135981.045000:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:2.0:1789135981.045017:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:2.0:1789135981.045031:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4793840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644693888:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135981.045058:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4793840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644693888:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135981.045064:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:1.0:1789135981.045340:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693504 00000100:00100000:1.0:1789135981.045345:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693504 00000100:00100000:1.0:1789135981.045381:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694016 00000100:00100000:1.0:1789135981.045383:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694016 00000100:00100000:1.0:1789135981.045403:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693632 00000100:00100000:1.0:1789135981.045406:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693632 00000100:00100000:1.0:1789135981.045419:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694144 00000100:00100000:1.0:1789135981.045421:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694144 00000100:00100000:1.0:1789135981.045436:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 389 00000100:00100000:1.0:1789135981.045443:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4793c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2391:x1876044644693504:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135981.045478:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4793c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2391:x1876044644693504:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 36us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135981.045484:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 389 00000100:00100000:1.0:1789135981.045500:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 390 00000100:00100000:1.0:1789135981.045505:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644694016:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135981.045546:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644694016:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 39us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135981.045551:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 390 00000100:00100000:1.0:1789135981.045563:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 391 00000100:00100000:1.0:1789135981.045569:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644693632:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135981.045590:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644693632:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135981.045595:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 391 00000100:00100000:1.0:1789135981.045615:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 392 00000100:00100000:1.0:1789135981.045622:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4792580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644694144:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135981.045646:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4792580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644694144:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135981.045652:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 392 00000100:00100000:2.0:1789135981.047322:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644693376 00000100:00100000:2.0:1789135981.047336:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644693376 00000100:00100000:2.0:1789135981.048524:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 463 00000100:00100000:2.0:1789135981.048538:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644693376:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135981.048620:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644693376:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 86us (3944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135981.048628:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 463 00000100:00080000:3.0:1789135981.051511:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135981.051522:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135981.051525:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135981.051528:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789135981.153195:0:15172:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:12:59 (1789135979) 00010000:00010000:2.0:1789135981.800514:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135982.827085:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135983.118532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135983.118659:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694400 00000100:00100000:1.0:1789135983.118670:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694400 00000100:00100000:1.0:1789135983.118770:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 150 00000100:00100000:1.0:1789135983.118782:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+14:12413:x1876044644694400:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135983.118813:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135983.118839:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3450 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b21 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789135983.119041:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135983.119301:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119318:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119332:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119388:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119396:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119413:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119655:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3465 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119664:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3465 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.119671:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3465 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135983.119680:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789135983.120643:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120653:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120659:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120665:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135983.120669:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120676:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120689:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7fa59fb00) 00010000:00010000:1.0:1789135983.120693:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135983.120697:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120715:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3457 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120813:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120820:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120824:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120828:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135983.120831:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120836:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.120843:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a7e0aa7f00) 00010000:00010000:1.0:1789135983.120846:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135983.121118:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.121127:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de345e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.121452:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3450 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b21 expref: 17 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.121489:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3465 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b21 expref: 16 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135983.121497:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:1.0:1789135983.121499:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135983.121501:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879e00, rc 0) 00000100:00100000:1.0:1789135983.121589:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+16:12413:x1876044644694400:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2809us (3076us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789135983.121601:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 150 00000100:00100000:0.0:1789135983.136386:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135983.136550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135983.137457:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694656 00000100:00100000:3.0:1789135983.137469:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694656 00000100:00100000:3.0:1789135983.137554:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:3.0:1789135983.137565:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+16:2390:x1876044644694656:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135983.137582:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135983.137607:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3465 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b21 expref: 16 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135983.137627:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:3.0:1789135983.137631:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135983.137699:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+15:2390:x1876044644694656:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 135us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135983.137706:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:2.0:1789135983.144395:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694528 00000100:00100000:2.0:1789135983.144410:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694528 00000100:00100000:2.0:1789135983.144507:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 151 00000100:00100000:2.0:1789135983.144518:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+15:12413:x1876044644694528:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789135983.144639:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+15:12413:x1876044644694528:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 123us (8263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135983.144647:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 151 00000100:00100000:0.0:1789135983.156548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135983.156842:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694784 00000100:00100000:3.0:1789135983.156878:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694784 00000100:00100000:3.0:1789135983.156956:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:3.0:1789135983.156967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:12413:x1876044644694784:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789135983.157050:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135983.157159:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:12413:x1876044644694784:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 194us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135983.157168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 152 00000040:00080000:0.0:1789135983.784085:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135983.784093:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135983.784194:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789135983.784202:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789135983.849640:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135983.978044:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135983.978080:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666801024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135983.978179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135983.978271:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801024 00000100:00100000:3.0:1789135983.978280:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801024 00000100:00100000:3.0:1789135983.978340:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789135983.978351:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666801024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789135983.978402:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789135983.978462:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666801024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135983.978470:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789135983.978529:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666801024:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789135983.985294:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789135984.490471:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c45443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666801280:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490643:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c45452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666801792:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490693:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666802304:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490742:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789135984.490748:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c45461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666801152:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490812:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666801664:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490852:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666802176:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490934:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666801536:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.490964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.490981:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666802048:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.491150:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4c01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666802560:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.491198:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789135984.491216:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666801408:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.491255:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666801920:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.491293:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666802432:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491313:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135984.491348:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801280 00000100:00100000:1.0:1789135984.491359:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801280 00000100:00100000:1.0:1789135984.491413:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801792 00000100:00100000:1.0:1789135984.491416:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801792 00000100:00100000:1.0:1789135984.491444:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802304 00000100:00100000:1.0:1789135984.491447:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802304 00000100:00100000:1.0:1789135984.491460:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801664 00000100:00100000:1.0:1789135984.491463:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801664 00000100:00100000:1.0:1789135984.491475:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802176 00000100:00100000:1.0:1789135984.491478:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802176 00000100:00100000:1.0:1789135984.491490:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801408 00000100:00100000:1.0:1789135984.491492:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801408 00000100:00100000:1.0:1789135984.491506:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789135984.491514:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666801280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491582:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666801280:12345-0@lo:400:kworker.0 Request processed in 68us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.491598:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789135984.491622:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789135984.491628:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666801792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.491658:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666801792:12345-0@lo:400:kworker.0 Request processed in 31us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.491664:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789135984.491677:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789135984.492407:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666802304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.492461:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666802304:12345-0@lo:400:kworker.0 Request processed in 64us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.492468:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789135984.492492:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789135984.492500:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666801664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.492528:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666801664:12345-0@lo:400:kworker.0 Request processed in 30us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.492534:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789135984.493244:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666802688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135984.493299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135984.493362:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801152 00000100:00100000:3.0:1789135984.493369:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801152 00000100:00100000:3.0:1789135984.493417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789135984.493424:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666801152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.493473:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666801152:12345-0@lo:400:kworker.0 Request processed in 49us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135984.493480:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789135984.493515:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801536 00000100:00100000:3.0:1789135984.493518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801536 00000100:00100000:3.0:1789135984.493555:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789135984.493562:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666801536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.493601:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666801536:12345-0@lo:400:kworker.0 Request processed in 39us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135984.493607:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789135984.493627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789135984.493636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666802176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.493665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666802176:12345-0@lo:400:kworker.0 Request processed in 31us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135984.493672:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789135984.493687:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789135984.493693:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666801408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.493716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666801408:12345-0@lo:400:kworker.0 Request processed in 23us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135984.493721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789135984.493738:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802688 00000100:00100000:3.0:1789135984.493741:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802688 00000100:00100000:3.0:1789135984.493778:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135984.493785:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666802688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135984.493816:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135984.493881:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666802688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135984.493888:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789135984.493944:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666802688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789135984.493989:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666801408:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.495969:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802048 00000100:00100000:1.0:1789135984.495989:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802048 00000100:00100000:1.0:1789135984.496121:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802560 00000100:00100000:1.0:1789135984.496125:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802560 00000100:00100000:1.0:1789135984.496141:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666801920 00000100:00100000:1.0:1789135984.496143:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666801920 00000100:00100000:1.0:1789135984.496154:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802432 00000100:00100000:1.0:1789135984.496157:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802432 00000100:00100000:1.0:1789135984.496178:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135984.496189:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666802048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496308:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c00780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666802048:12345-0@lo:400:kworker.0 Request processed in 121us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.496316:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789135984.496336:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135984.496342:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666802560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496372:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666802560:12345-0@lo:400:kworker.0 Request processed in 30us (5197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.496377:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789135984.496387:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789135984.496393:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666801920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496419:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666801920:12345-0@lo:400:kworker.0 Request processed in 26us (5143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.496425:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789135984.496437:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789135984.496443:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666802432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496470:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666802432:12345-0@lo:400:kworker.0 Request processed in 28us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135984.496476:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1789135984.496513:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789135984.496518:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135984.496522:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789135984.496525:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789135984.496580:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c45461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666801152:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496599:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666801664:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496613:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666802176:0@lo:400:kworker.0 00000100:00100000:1.0:1789135984.496638:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c45443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666801280:0@lo:400:kworker.0 00010000:00080000:1.0:1789135984.496654:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c45452c0 x1876044666801792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135984.496666:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c45452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666801792:0@lo:400:kworker.0 00010000:00080000:1.0:1789135984.496680:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4547c00 x1876044666802304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789135984.496690:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666802304:0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.496810:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666801536:0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.496833:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666802048:0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.496845:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4c01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666802560:0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.496894:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666801920:0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.496906:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666802432:0@lo:400:kworker.0 00000100:00100000:3.0:1789135984.499015:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789135984.508905:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4790b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666802816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135984.509139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135984.509305:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802816 00000100:00100000:0.0:1789135984.509318:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802816 00000100:00100000:0.0:1789135984.509389:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789135984.509401:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666802816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135984.509436:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135984.509497:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666802816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135984.509505:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789135984.509641:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4790b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666802816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789135984.873457:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135985.000939:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4791680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666802944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135985.001040:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135985.001127:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789135985.001133:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666803072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789135985.001156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135985.001191:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666802944 00000100:00100000:3.0:1789135985.001199:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666802944 00000100:00100000:1.0:1789135985.001214:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666803072 00000100:00100000:1.0:1789135985.001220:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666803072 00000100:00100000:1.0:1789135985.001278:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789135985.001291:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666803072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789135985.001334:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789135985.001393:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666803072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.001402:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789135985.001444:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789135985.001453:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666802944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135985.001463:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666803072:0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135985.001498:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789135985.001712:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666802944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135985.001720:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789135985.004836:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4791680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666802944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135985.410839:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.414298:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644694912 00000100:00100000:1.0:1789135985.414319:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644694912 00000100:00100000:1.0:1789135985.414467:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 153 00000100:00100000:1.0:1789135985.414482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+15:12456:x1876044644694912:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135985.414514:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135985.414546:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b28 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414662:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414680:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414697:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414715:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414722:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414728:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414797:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414805:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414812:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414820:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135985.414824:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414843:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414886:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:1.0:1789135985.414890:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135985.414897:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.414904:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de347a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789135985.415104:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135985.415185:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415192:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415199:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415205:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135985.415208:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415213:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415222:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135985.415225:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135985.415228:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415247:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3481 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415292:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3473 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b28 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415304:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:1.0:1789135985.415306:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135985.415310:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de3473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b28 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.415319:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878000, rc 0) 00000100:00100000:1.0:1789135985.415472:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+15:12456:x1876044644694912:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 992us (4647us total) trans 0 rc 301/301 00000100:00100000:1.0:1789135985.415481:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 153 00000100:00100000:0.0:1789135985.429341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.429450:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644695168 00000100:00100000:1.0:1789135985.429465:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644695168 00000100:00100000:1.0:1789135985.429554:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:1.0:1789135985.429566:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4778b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+15:12456:x1876044644695168:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:1.0:1789135985.429646:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135985.429683:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de2dc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0894c expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.429707:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:1.0:1789135985.429714:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135985.429803:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.429841:0:14529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 5 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.429851:0:14529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.430061:0:14529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 5 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.430078:0:14529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 5 pid: 14529 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135985.430097:0:14529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14529:1876044666803200:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135985.430231:0:14529:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450900 going to sleep for 11 seconds 00000100:00100000:3.0:1789135985.443440:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.443745:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644695296 00000100:00100000:1.0:1789135985.443768:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644695296 00010000:00010000:1.0:1789135985.443839:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 6 pid: 14529 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135985.443901:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:1.0:1789135985.443912:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2392:x1876044644695296:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135985.443931:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135985.443939:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 6 pid: 14529 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.443956:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 6 pid: 14529 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444001:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:1.0:1789135985.444008:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444019:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444027:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444050:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135985.444124:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2392:x1876044644695296:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 213us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.444134:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00080000:1.0:1789135985.444170:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135985.444309:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae000/0x559c8745c6de3449 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b1a expref: 5 pid: 14529 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135985.444328:0:14529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14529:1876044666803200:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135985.444353:0:14529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444363:0:14529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444369:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444396:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444416:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.444423:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445191:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445205:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445214:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135985.445232:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004fd73eb9 reply state 00000000d9412da8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445247:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445254:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135985.445260:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135985.445264:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789135985.445273:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789135985.445281:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445287:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445295:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445309:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135985.445315:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445325:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445337:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7800) 00010000:00010000:1.0:1789135985.445340:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135985.445344:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445350:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3488 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135985.445369:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004fd73eb9 reply state 00000000d9412da8 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445377:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.445382:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135985.445385:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135985.445387:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789135985.445484:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4778b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+16:12456:x1876044644695168:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 15919us (16161us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789135985.445494:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:3.0:1789135985.517536:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666803328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135985.517641:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135985.517760:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666803328 00000100:00100000:3.0:1789135985.517771:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666803328 00000100:00100000:3.0:1789135985.517830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789135985.517840:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666803328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135985.517907:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135985.517959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666803328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135985.517967:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789135985.518025:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666803328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789135985.589371:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.589723:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644695424 00000100:00100000:1.0:1789135985.589738:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644695424 00000100:00100000:1.0:1789135985.589835:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 155 00000100:00100000:1.0:1789135985.589896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+16:12464:x1876044644695424:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:1.0:1789135985.589934:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135985.589971:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de349d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b2f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.590367:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de34a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.590386:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de34a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.590402:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de34a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135985.590461:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789135985.590466:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135985.590496:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de34a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.590713:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de349d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b2f expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.590736:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de34a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b2f expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.590746:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:1.0:1789135985.590760:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135985.590765:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878000, rc 0) 00000100:00100000:1.0:1789135985.592037:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+17:12464:x1876044644695424:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 959us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.592079:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 155 00000100:00100000:3.0:1789135985.654458:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.654808:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644695552 00000100:00100000:1.0:1789135985.654822:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644695552 00000100:00100000:1.0:1789135985.654970:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 156 00000100:00100000:1.0:1789135985.654991:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+17:12470:x1876044644695552:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135985.655021:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135985.655050:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de34ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b36 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655139:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655159:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655172:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655184:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655191:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655198:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655300:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de34c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655333:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655339:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135985.655385:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789135985.655389:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135985.655417:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655688:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655696:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655706:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655712:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135985.655717:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655725:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655739:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:1.0:1789135985.655743:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135985.655757:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655776:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de34b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655793:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655799:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655804:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655809:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135985.655813:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655819:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655827:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a7e0aa7400) 00010000:00010000:1.0:1789135985.655830:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135985.655833:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655838:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de34b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655913:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de34ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b36 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655930:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de34c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b36 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.655945:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135985.655947:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789135985.655950:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d200, rc 0) 00000100:00100000:1.0:1789135985.656650:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+18:12470:x1876044644695552:12345-192.168.201.31@tcp:101:bash.0 Request processed in 1663us (2200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.656662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 156 00000100:00100000:0.0:1789135985.660190:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135985.660618:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644695808 00000100:00100000:3.0:1789135985.660631:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644695808 00000100:00100000:3.0:1789135985.660717:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 157 00000100:00100000:3.0:1789135985.660729:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4779680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+18:12470:x1876044644695808:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135985.660764:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135985.660791:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de34c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b3d expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.660997:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.661016:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.661030:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.661048:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.661055:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.661062:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135985.662475:0:14528:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789135985.662706:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662723:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662735:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662790:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662815:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662823:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662830:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135985.662835:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662844:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662874:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:3.0:1789135985.662877:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135985.662883:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662889:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de34ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135985.662906:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006c64daf8 reply state 0000000091324fc3 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662918:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.662925:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:3.0:1789135985.662927:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135985.662930:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135985.662977:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de34c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 21 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.663000:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 20 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.663008:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:3.0:1789135985.663011:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135985.663013:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafc00, rc 0) 00000100:00100000:3.0:1789135985.663117:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4779680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12470:x1876044644695808:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2390us (2944us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789135985.663128:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 157 00000100:00100000:3.0:1789135985.670674:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.670811:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644695936 00000100:00100000:1.0:1789135985.670825:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644695936 00000100:00100000:1.0:1789135985.670964:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:1.0:1789135985.670978:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2392:x1876044644695936:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135985.671008:0:8536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135985.671034:0:8536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b44 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789135985.671068:0:8536:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789135985.671094:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=433s v=(0 0) 00010000:00010000:1.0:1789135985.671100:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135985.671112:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 6 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.671138:0:8536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 6 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.671163:0:8536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ce00, rc 0) 00000100:00100000:1.0:1789135985.671234:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644695936:12345-192.168.201.31@tcp:101:bash.0 Request processed in 259us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.671260:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00080000:3.0:1789135985.671520:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135985.688460:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.689010:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644696064 00000100:00100000:1.0:1789135985.689023:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644696064 00000100:00100000:1.0:1789135985.689100:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1789135985.689112:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4792d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+6:12470:x1876044644696064:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135985.689138:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135985.689178:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b4b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.689230:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 7 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.689249:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135985.689254:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135985.689261:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.689302:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 7 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.689318:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 7 pid: 8536 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135985.689335:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1876044666803456:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135985.689463:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa4500c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135985.695065:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135985.695188:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644696192 00000100:00100000:3.0:1789135985.695203:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644696192 00010000:00010000:3.0:1789135985.695267:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 8 pid: 8536 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135985.695368:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:3.0:1789135985.695381:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644696192:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135985.695403:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135985.695434:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 8 pid: 8536 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.695453:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 8 pid: 8536 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.695530:0:13680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135985.695537:0:13680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135985.695548:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.695561:0:13680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.695636:0:13680:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135985.695656:0:13680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13680:1876044666803584:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789135985.695890:0:13680:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07480 going to sleep for 11 seconds 00010000:00010000:1.0:1789135985.695897:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7f4c85/0x559c8745c6de34ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b44 expref: 8 pid: 8536 timeout: 533 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135985.695930:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1876044666803456:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135985.695965:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.695978:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167da00, rc 0) 00000100:00100000:1.0:1789135985.696015:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4792d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:12470:x1876044644696064:12345-192.168.201.31@tcp:101:bash.0 Request processed in 6905us (7569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.696024:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:0.0:1789135985.702602:0:13680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:13680:1876044666803584:192.168.201.31@tcp:105: 00010000:00010000:0.0:1789135985.702642:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135985.702731:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644696192:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 7351us (7683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135985.702755:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:2.0:1789135985.703818:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135985.706383:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644696448 00000100:00100000:0.0:1789135985.706407:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644696448 00000100:00100000:0.0:1789135985.706501:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:0.0:1789135985.706515:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4791e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12470:x1876044644696448:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:0.0:1789135985.707026:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4791e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12470:x1876044644696448:12345-192.168.201.31@tcp:35:bash.0 Request processed in 512us (3279us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789135985.707036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:3.0:1789135985.807687:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135985.808334:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644696704 00000100:00100000:2.0:1789135985.808366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644696704 00000100:00100000:2.0:1789135985.808483:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 158 00000100:00100000:2.0:1789135985.808496:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12480:x1876044644696704:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135985.808549:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135985.808587:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de34f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b52 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135985.808726:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789135985.808893:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de34f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b52 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.808911:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:2.0:1789135985.808914:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135985.808921:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de34f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b52 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.808938:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5200, rc 0) 00000100:00100000:2.0:1789135985.809039:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12480:x1876044644696704:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 545us (1532us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789135985.809048:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 158 00000100:00100000:1.0:1789135985.812510:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135985.812791:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644696960 00000100:00100000:0.0:1789135985.812806:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644696960 00000100:00100000:0.0:1789135985.812965:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:0.0:1789135985.812988:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12480:x1876044644696960:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135985.813418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12480:x1876044644696960:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 439us (920us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789135985.813438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00010000:00010000:3.0:1789135985.896597:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135985.913281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135985.914378:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644697088 00000100:00100000:2.0:1789135985.914395:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644697088 00000100:00100000:2.0:1789135985.914841:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:2.0:1789135985.914874:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12486:x1876044644697088:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135985.915042:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135985.915250:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b59 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.915384:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de350d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.915402:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de350d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.915416:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de350d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135985.915477:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789135985.915482:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135985.916716:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de350d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.916782:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b59 expref: 26 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.916807:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de350d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b59 expref: 25 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.916818:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135985.916821:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135985.916825:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5a00, rc 0) 00000100:00100000:2.0:1789135985.917771:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+25:12486:x1876044644697088:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 2912us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135985.917781:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:1.0:1789135985.923758:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135985.924010:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644697344 00000100:00100000:2.0:1789135985.924033:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644697344 00000100:00100000:2.0:1789135985.924182:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:2.0:1789135985.924194:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+25:12486:x1876044644697344:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135985.924223:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135985.924251:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3514 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b60 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.924403:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de351b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.924422:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de351b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.924436:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de351b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135985.924451:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789135985.924602:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3514 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b60 expref: 28 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.924623:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de351b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b60 expref: 27 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.924633:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:2.0:1789135985.924637:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135985.924641:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5800, rc 0) 00000100:00100000:2.0:1789135985.924720:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12486:x1876044644697344:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 528us (988us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789135985.924727:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:1.0:1789135985.927772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.927917:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135985.928325:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644697472 00000100:00100000:3.0:1789135985.928339:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644697472 00000100:00100000:3.0:1789135985.928440:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1789135985.928453:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+27:2390:x1876044644697472:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135985.928473:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135985.928506:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de351b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b60 expref: 27 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.928542:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:3.0:1789135985.928567:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135985.928661:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+26:2390:x1876044644697472:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 210us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135985.928670:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789135985.930311:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644697728 00000100:00100000:0.0:1789135985.930326:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644697728 00000100:00100000:0.0:1789135985.930414:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:0.0:1789135985.930431:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12486:x1876044644697728:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135985.930471:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135985.930493:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3529 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b67 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.930707:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3530 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.930723:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3530 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.930735:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3530 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135985.930756:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789135985.931411:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3529 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b67 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.931449:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3530 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b67 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.931460:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:0.0:1789135985.931464:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789135985.931468:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3ea00, rc 0) 00000100:00100000:0.0:1789135985.931851:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12486:x1876044644697728:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1426us (4091us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1789135985.931880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:1.0:1789135985.941520:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135985.941713:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644697856 00000100:00100000:2.0:1789135985.941756:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644697856 00000100:00100000:2.0:1789135985.941831:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:2.0:1789135985.941843:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2389:x1876044644697856:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:2.0:1789135985.942104:0:8536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.942131:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.942140:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789135985.942146:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135985.942152:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.942324:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.942344:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 6 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135985.942366:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4792940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8536:1876044666803712:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135985.942686:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789135985.947850:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135985.948228:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4792940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8536:1876044666803712:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135985.948262:0:8536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135985.949060:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644697984 00000100:00100000:0.0:1789135985.949138:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644697984 00002000:00100000:0.0:1789135985.949274:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90a7ff6b03c0 x1876044644697984/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:416/0 lens 504/0 e 0 to 0 dl 1789135996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135985.949298:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7ff6b03c0 with x1876044644697984 ext(0->12) 00010000:00010000:0.0:1789135985.949310:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 7 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.949329:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 7 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135985.949339:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a7ff6b03c0 00000100:00100000:0.0:1789135985.949430:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1789135985.949442:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644697984:12345-192.168.201.31@tcp:4:lfs.0 00000100:00100000:0.0:1789135985.951943:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2392:x1876044644697984:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 2485us (4092us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789135985.951962:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00002000:00100000:0.0:1789135985.951975:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90a7ff6b03c0 x1876044644697984/t4294967306(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:416/0 lens 504/448 e 0 to 0 dl 1789135996 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135985.951992:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7ff6b03c0 with x1876044644697984 ext(0->12) 00010000:00010000:0.0:1789135985.952003:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 9 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.952023:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 9 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135985.952029:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a7ff6b03c0 00000100:00100000:2.0:1789135985.956279:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135985.956369:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644698112 00000100:00100000:1.0:1789135985.956382:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644698112 00010000:00010000:1.0:1789135985.956673:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 9 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135985.956782:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:1.0:1789135985.956793:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4792940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644698112:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135985.956810:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789135985.956831:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789135985.956834:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789135985 00002000:00010000:1.0:1789135985.956851:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789135985 00002000:00010000:1.0:1789135985.956877:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789135985 00002000:00010000:1.0:1789135985.956879:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789135985.956886:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 9 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.956901:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 9 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.956941:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fee86da/0x559c8745c6de34f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b4b expref: 9 pid: 8429 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.956964:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135985.956969:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135985.956985:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.956999:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135985.957028:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135985.957096:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4792940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644698112:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 305us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135985.957101:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 95 00010000:00010000:2.0:1789135985.957362:0:8536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957374:0:8536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957398:0:8536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957407:0:8536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957417:0:8536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957435:0:8536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135985.957440:0:8536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957451:0:8536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957465:0:8536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.957487:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de353e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135985.958800:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2389:x1876044644697856:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 16947us (17294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135985.958815:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:2.0:1789135985.966378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135985.966971:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644698368 00000100:00100000:3.0:1789135985.967044:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644698368 00000100:00100000:3.0:1789135985.967317:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:3.0:1789135985.967331:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12486:x1876044644698368:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:3.0:1789135985.967440:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3530 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b67 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135985.967754:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789135985.967793:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789135985.970382:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1789135985.970477:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.970502:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 32 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.970526:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.970696:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 32 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.970717:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 32 pid: 14528 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135985.970735:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4790f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1876044666803840:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135985.971139:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789135985.977414:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4790f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1876044666803840:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135985.977459:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135985.977985:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135985.978507:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644698496 00000100:00100000:3.0:1789135985.978533:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644698496 00010000:00010000:3.0:1789135985.978601:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 33 pid: 14528 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135985.978645:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 96 00000100:00100000:3.0:1789135985.978656:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+33:2391:x1876044644698496:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135985.978675:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135985.978683:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 33 pid: 14528 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.978698:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 33 pid: 14528 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.978754:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de34dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b3d expref: 33 pid: 14528 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.978775:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:3.0:1789135985.978781:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.978793:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.978801:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135985.978835:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135985.978942:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+32:2391:x1876044644698496:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 286us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135985.978952:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 96 00010000:00010000:2.0:1789135985.980315:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135985.980333:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135985.980501:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1789135985.981479:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789135985.982472:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4790f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666803968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135985.982793:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135985.982841:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135985.983237:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666803968 00000100:00100000:3.0:1789135985.983247:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666803968 00000100:00100000:3.0:1789135985.983350:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789135985.983363:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c6e46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876044666803968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789135985.983497:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c6e46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876044666803968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 136us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135985.983507:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789135985.984061:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4790f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666803968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789135985.984635:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1789135985.984751:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4c01a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666804096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789135985.984813:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135985.985585:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450780 going to sleep for 11 seconds 00000100:00100000:3.0:1789135985.986771:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666804096 00000100:00100000:3.0:1789135985.986787:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666804096 00000100:00100000:3.0:1789135985.986874:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789135985.986886:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876044666804096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789135985.987757:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6518:x1876044666804096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 860us (2930us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789135985.987768:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789135985.987954:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4c01a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666804096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789135985.988308:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789135985.988378:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.988391:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.988400:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.988407:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135985.988413:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.988422:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.988442:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:0.0:1789135985.988446:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789135985.988452:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.988460:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3545 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135985.988802:0:6518:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789135985.988948:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789135985.988962:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434108106935ns, next at 435108104317ns, rc = 0 00000001:00080000:0.0:1789135985.988970:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789135985.989160:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3100) 00010000:00010000:0.0:1789135985.989164:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789135985.989258:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3530 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b67 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135985.989427:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+35:12486:x1876044644698368:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 22098us (23065us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789135985.989900:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000020:00080000:0.0:1789135985.989974:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789135985.996016:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135985.996323:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644698624 00000100:00100000:0.0:1789135985.996338:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644698624 00000100:00100000:0.0:1789135985.996423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:0.0:1789135985.996435:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+35:12486:x1876044644698624:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135985.996468:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135985.996503:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de354c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b6e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.996808:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de354c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b6e expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.996826:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de354c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b6e expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135985.996850:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135985.997153:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135985.997159:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f800, rc 0) 00000100:00100000:0.0:1789135985.997349:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+36:12486:x1876044644698624:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 915us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135985.997359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:3.0:1789135986.004545:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135986.004829:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644698880 00000100:00100000:0.0:1789135986.004889:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644698880 00000100:00100000:0.0:1789135986.004982:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1789135986.004997:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+36:12486:x1876044644698880:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135986.005836:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+37:12486:x1876044644698880:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 838us (1618us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789135986.005847:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1789135986.141110:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.141287:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644699136 00000100:00100000:1.0:1789135986.141303:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644699136 00000100:00100000:1.0:1789135986.141412:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:1.0:1789135986.141432:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+37:12496:x1876044644699136:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135986.141469:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135986.141497:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b75 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135986.141663:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789135986.141813:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3553 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b75 expref: 39 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.141832:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:1.0:1789135986.141835:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135986.141840:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b75 expref: 39 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.141902:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167da00, rc 0) 00000100:00100000:1.0:1789135986.141988:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12496:x1876044644699136:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 565us (893us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1789135986.142019:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:2.0:1789135986.148198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.148374:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644699264 00000100:00100000:1.0:1789135986.148392:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644699264 00000100:00100000:1.0:1789135986.148497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:1.0:1789135986.148728:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4791680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12496:x1876044644699264:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:1.0:1789135986.148890:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.148912:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.148927:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.148941:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.148948:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.148955:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149220:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149232:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149240:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135986.149336:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149355:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149764:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149773:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149781:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167da00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135986.149786:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149797:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149814:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135986.149817:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135986.149824:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149832:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3561 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149925:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149934:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149952:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149958:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167de00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135986.149962:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.149969:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150212:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:1.0:1789135986.150216:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135986.150220:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150227:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de3568 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150240:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150248:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150254:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150260:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ce00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135986.150264:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150282:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150292:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135986.150295:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135986.150298:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.150304:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de356f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135986.150936:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4791680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12496:x1876044644699264:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 2420us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135986.150954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:3.0:1789135986.156367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.156449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644699520 00000100:00100000:1.0:1789135986.156463:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644699520 00000100:00100000:1.0:1789135986.156620:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:1.0:1789135986.156634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12496:x1876044644699520:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135986.156996:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+39:12496:x1876044644699520:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 364us (647us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789135986.157005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:2.0:1789135986.167882:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.167937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.167972:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.167997:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.168022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.168069:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644700160 00000100:00100000:2.0:1789135986.168081:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644700160 00000100:00100000:2.0:1789135986.168160:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644699776 00000100:00100000:2.0:1789135986.168164:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644699776 00000100:00100000:2.0:1789135986.168183:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644700032 00000100:00100000:2.0:1789135986.168186:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644700032 00000100:00100000:2.0:1789135986.168210:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 399 00000100:00100000:2.0:1789135986.168222:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644700160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135986.168332:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4790780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644700160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135986.168355:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 399 00000100:00100000:2.0:1789135986.168404:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 400 00000100:00100000:2.0:1789135986.168410:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4791e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644699776:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135986.168447:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4791e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644699776:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 38us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135986.168454:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 400 00000100:00100000:2.0:1789135986.168466:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 401 00000100:00100000:2.0:1789135986.168472:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4790f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644700032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135986.168494:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4790f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644700032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135986.168500:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 401 00000100:00100000:0.0:1789135986.168998:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644699904 00000100:00100000:0.0:1789135986.169006:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644699904 00000100:00100000:0.0:1789135986.169066:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:0.0:1789135986.169077:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4790b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644699904:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135986.169116:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4790b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2391:x1876044644699904:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 43us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135986.169123:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:3.0:1789135986.169956:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644699648 00000100:00100000:3.0:1789135986.169965:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644699648 00000100:00100000:3.0:1789135986.170032:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 465 00000100:00100000:3.0:1789135986.170041:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644699648:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135986.170103:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644699648:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 63us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135986.170110:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 465 00000100:00080000:3.0:1789135986.170154:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135986.170161:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789135986.211493:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135986.212033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644700416 00000100:00100000:0.0:1789135986.212047:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644700416 00000100:00100000:0.0:1789135986.212143:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:0.0:1789135986.212157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+39:12499:x1876044644700416:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135986.212194:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135986.212223:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3576 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b7c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.212327:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.212346:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.212360:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.212395:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.212404:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.212411:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213291:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213310:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213318:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135986.213331:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789135986.213810:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213820:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213828:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213836:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135986.213841:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213904:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213921:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135986.213924:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135986.213931:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213938:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de357d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213955:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213962:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213968:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213983:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135986.213987:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.213993:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.214002:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:0.0:1789135986.214005:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135986.214008:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.214027:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3584 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.214104:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3576 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.214119:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.214128:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135986.214130:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135986.214133:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f600, rc 0) 00000100:00100000:0.0:1789135986.214239:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+41:12499:x1876044644700416:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 2085us (2761us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789135986.214250:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:0.0:1789135986.224014:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.224201:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644700544 00000100:00100000:2.0:1789135986.224215:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644700544 00000100:00100000:2.0:1789135986.224299:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:2.0:1789135986.224311:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+41:12499:x1876044644700544:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1789135986.224418:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224782:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224800:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224847:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224909:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224938:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224946:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135986.224951:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224961:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224978:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:2.0:1789135986.224981:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135986.224989:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.224996:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3599 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135986.225184:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+41:12499:x1876044644700544:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 872us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135986.225194:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:2.0:1789135986.233753:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135986.233912:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644700800 00000100:00100000:3.0:1789135986.233925:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644700800 00000100:00100000:3.0:1789135986.234008:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:3.0:1789135986.234020:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+41:12499:x1876044644700800:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135986.234715:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+42:12499:x1876044644700800:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 691us (985us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789135986.234726:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:3.0:1789135986.648824:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135986.649015:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644701056 00000100:00100000:2.0:1789135986.649028:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644701056 00000100:00100000:2.0:1789135986.649112:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:2.0:1789135986.649125:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+42:12530:x1876044644701056:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1789135986.649165:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135986.649196:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de35a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b83 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.649359:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de35a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.649379:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.649395:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135986.649408:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789135986.649766:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de35a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b83 expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.649791:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de35a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b83 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135986.649801:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:2.0:1789135986.649805:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135986.649810:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5e00, rc 0) 00000100:00100000:2.0:1789135986.649939:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12530:x1876044644701056:12345-192.168.201.31@tcp:101:cat.0 Request processed in 815us (1133us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789135986.649948:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:0.0:1789135986.657466:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.657725:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644701184 00000100:00100000:1.0:1789135986.657942:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644701184 00000100:00100000:1.0:1789135986.658047:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1789135986.658059:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+44:2389:x1876044644701184:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135986.658081:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135986.658117:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de35a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b83 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.658162:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135986.658169:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135986.658243:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+43:2389:x1876044644701184:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 187us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135986.658253:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789135986.658717:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135986.658809:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644701440 00000100:00100000:3.0:1789135986.658816:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644701440 00000100:00100000:3.0:1789135986.658885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:3.0:1789135986.658902:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4779e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+43:12530:x1876044644701440:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:3.0:1789135986.659182:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4779e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12530:x1876044644701440:12345-192.168.201.31@tcp:35:cat.0 Request processed in 280us (466us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789135986.659190:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:3.0:1789135986.734956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.736109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644701696 00000100:00100000:1.0:1789135986.736131:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644701696 00000100:00100000:1.0:1789135986.736227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 168 00000100:00100000:1.0:1789135986.736240:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12536:x1876044644701696:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:1.0:1789135986.736276:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135986.736281:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135986.736322:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de350d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b59 expref: 44 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.736347:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135986.736353:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135986.736372:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de35b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b8a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.736523:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.736539:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.736549:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.736614:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.736630:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 44 pid: 6516 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135986.736647:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666804224:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135986.736824:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789135986.743228:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4c03840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666804224:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135986.743270:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135986.743447:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.743704:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644701824 00000100:00100000:1.0:1789135986.743717:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644701824 00010000:00010000:1.0:1789135986.743787:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 45 pid: 6516 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135986.743834:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:1.0:1789135986.743846:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+45:2392:x1876044644701824:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135986.743910:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135986.743920:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 45 pid: 6516 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.743937:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 45 pid: 6516 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.743980:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de358b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b7c expref: 45 pid: 6516 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.744002:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135986.744029:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.744041:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.744050:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.744084:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135986.744140:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.744163:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135986.744186:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+44:2392:x1876044644701824:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 339us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135986.744215:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 97 00000004:00200000:0.0:1789135986.744411:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789135986.744642:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de35b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.744664:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.744673:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135986.744676:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135986.744681:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167da00, rc 0) 00000100:00100000:0.0:1789135986.745189:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12536:x1876044644701696:12345-192.168.201.31@tcp:101:dd.0 Request processed in 8949us (10240us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789135986.745198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 168 00000100:00100000:3.0:1789135986.760275:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135986.760464:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644701952 00000100:00100000:1.0:1789135986.760478:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644701952 00000100:00100000:1.0:1789135986.760575:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:1.0:1789135986.760588:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12536:x1876044644701952:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:1.0:1789135986.760623:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135986.760653:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de35ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b91 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.760697:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.760716:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.760742:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.761119:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de35ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 46 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.761155:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 45 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135986.761166:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135986.761554:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135986.761560:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ce00, rc 0) 00000100:00100000:1.0:1789135986.761658:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+45:12536:x1876044644701952:12345-192.168.201.31@tcp:101:dd.0 Request processed in 1070us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135986.761667:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:3.0:1789135986.765249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135986.765367:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644702208 00000100:00100000:0.0:1789135986.765381:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644702208 00000100:00100000:0.0:1789135986.765459:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 170 00000100:00100000:0.0:1789135986.765470:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+45:12536:x1876044644702208:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:0.0:1789135986.765843:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.765910:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.765924:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135986.766279:0:8299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1789135986.766329:0:8299:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008f35d90c reply state 00000000f4d5d1c7 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.766346:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135986.766355:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135986.766358:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135986.766364:0:8299:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135986.766493:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+48:12536:x1876044644702208:12345-192.168.201.31@tcp:36:dd.0 Request processed in 1022us (1259us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789135986.771761:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 170 00000020:00080000:0.0:1789135986.771782:0:8299:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789135986.922473:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789135987.110591:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135987.110731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644702336 00000100:00100000:0.0:1789135987.110745:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644702336 00000100:00100000:0.0:1789135987.110834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:0.0:1789135987.110892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+48:12550:x1876044644702336:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:0.0:1789135987.110925:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135987.110955:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de35df lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b98 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.111060:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.111079:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.111093:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.111105:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.111132:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.111139:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.112078:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.112101:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.112110:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.112349:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.112367:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 49 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135987.112381:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666804352:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135987.112608:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecad80 going to sleep for 11 seconds 00000100:00080000:3.0:1789135987.112706:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135987.118026:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135987.118346:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47783c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666804352:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135987.118387:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135987.121680:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644702592 00000100:00100000:1.0:1789135987.121702:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644702592 00000100:00100000:1.0:1789135987.121826:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1789135987.121841:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+50:10380:x1876044644702592:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789135987.128062:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+51:10380:x1876044644702592:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 6207us (10031us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789135987.128077:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:2.0:1789135987.133265:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.133698:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644702720 00000100:00100000:1.0:1789135987.133712:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644702720 00010000:00010000:1.0:1789135987.133786:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 51 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135987.133846:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:1.0:1789135987.133903:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+51:2390:x1876044644702720:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135987.133924:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135987.133950:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 51 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.134285:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 51 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.134320:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b8a expref: 51 pid: 6517 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.134344:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135987.134351:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.134364:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.134373:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.135799:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135987.135962:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+50:2390:x1876044644702720:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 2088us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135987.135979:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 98 00010000:00010000:2.0:1789135987.138358:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.138381:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135987.138827:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789135987.138834:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135987.141413:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141607:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141624:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141631:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141639:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141646:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135987.141652:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141661:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141683:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135987.141686:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135987.141694:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.141702:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de35e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143608:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143618:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143627:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143634:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135987.143639:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143648:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143668:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:2.0:1789135987.143671:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135987.143677:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143684:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de35ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143763:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de35df lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b98 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143782:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b98 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.143805:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:2.0:1789135987.143808:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135987.143811:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f400, rc 0) 00000100:00100000:2.0:1789135987.145696:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+49:12550:x1876044644702336:12345-192.168.201.31@tcp:101:stat.0 Request processed in 34823us (35099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135987.145713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1789135987.260492:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.260700:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644702976 00000100:00100000:1.0:1789135987.260712:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644702976 00000100:00100000:1.0:1789135987.260805:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:1.0:1789135987.260818:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+49:12556:x1876044644702976:12345-192.168.201.31@tcp:36:truncate.0 00010000:00010000:1.0:1789135987.260938:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135987.260990:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de35f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b98 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.261015:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135987.261022:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135987.261997:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.262024:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.262036:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135987.262098:0:14528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1789135987.262123:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006509d6a5 reply state 00000000373199de transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.262137:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.262145:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135987.262149:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135987.262166:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135987.262330:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+51:12556:x1876044644702976:12345-192.168.201.31@tcp:36:truncate.0 Request processed in 1512us (1850us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789135987.262341:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 172 00000020:00080000:1.0:1789135987.262350:0:14528:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789135987.639649:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135987.639796:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644703104 00000100:00100000:2.0:1789135987.639809:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644703104 00000100:00100000:2.0:1789135987.639964:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:2.0:1789135987.639976:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+51:12570:x1876044644703104:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:2.0:1789135987.640009:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135987.640047:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3602 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08b9f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640137:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640155:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640170:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640193:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640201:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640230:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640341:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640351:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640358:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135987.640416:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789135987.640422:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135987.640447:0:6515:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640461:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640470:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640476:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640483:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640489:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135987.640494:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640510:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640528:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135987.640532:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135987.640539:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640545:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3609 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640562:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640568:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640574:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640579:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135987.640582:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640587:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640594:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:2.0:1789135987.640596:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135987.640599:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640615:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de3610 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640648:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3602 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640662:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.640670:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:2.0:1789135987.640672:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135987.640675:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4800, rc 0) 00000100:00100000:2.0:1789135987.640769:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+52:12570:x1876044644703104:12345-192.168.201.31@tcp:101:stat.0 Request processed in 794us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135987.640776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:3.0:1789135987.809493:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.809771:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644703360 00000100:00100000:1.0:1789135987.809785:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644703360 00000100:00100000:1.0:1789135987.809969:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:1.0:1789135987.809982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+52:12579:x1876044644703360:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135987.810013:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135987.810055:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de361e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ba6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135987.813402:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789135987.813720:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de361e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ba6 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.813742:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:1.0:1789135987.813746:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135987.813752:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de361e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ba6 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.813772:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167de00, rc 0) 00000100:00100000:1.0:1789135987.814031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+53:12579:x1876044644703360:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 4050us (4552us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789135987.814051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:3.0:1789135987.818941:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.819599:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644703616 00000100:00100000:1.0:1789135987.819616:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644703616 00000100:00100000:1.0:1789135987.819701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1789135987.819744:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+53:12579:x1876044644703616:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135987.820113:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+54:12579:x1876044644703616:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 401us (1187us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789135987.820122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1789135987.918432:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.918659:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644703872 00000100:00100000:1.0:1789135987.918675:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644703872 00000100:00100000:1.0:1789135987.918763:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:1.0:1789135987.918774:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+54:12586:x1876044644703872:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135987.918806:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135987.918914:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de362c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bad expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.919082:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.919108:0:14528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.919120:0:14528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.919167:0:14528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.919182:0:14528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 55 pid: 6515 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135987.919199:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6b1680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666804480:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135987.919338:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135987.924959:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6b1680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666804480:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135987.925002:0:14528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135987.925431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135987.925767:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644704000 00000100:00100000:3.0:1789135987.925776:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644704000 00010000:00010000:3.0:1789135987.925915:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 56 pid: 6515 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135987.926023:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:3.0:1789135987.926209:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+56:2391:x1876044644704000:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135987.926232:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135987.926241:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 56 pid: 6515 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.926257:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 56 pid: 6515 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.926314:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3617 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b9f expref: 56 pid: 6515 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.926335:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:3.0:1789135987.926341:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.926457:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.926469:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.926570:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135987.926715:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+55:2391:x1876044644704000:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 501us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135987.926725:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 99 00010000:00010000:1.0:1789135987.926845:0:14528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.926878:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135987.926919:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789135987.927115:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de362c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 56 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.927142:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 55 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.927151:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135987.927154:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789135987.927157:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879e00, rc 0) 00000100:00100000:1.0:1789135987.927190:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2310f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+55:12586:x1876044644703872:12345-192.168.201.31@tcp:101:bash.0 Request processed in 8417us (8776us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789135987.927197:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:2.0:1789135987.938269:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.938560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644704256 00000100:00100000:1.0:1789135987.938573:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644704256 00000100:00100000:1.0:1789135987.938670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 176 00000100:00100000:1.0:1789135987.938680:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+55:12586:x1876044644704256:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:1.0:1789135987.939053:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.939078:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.939091:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789135987.939144:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789135987.939187:0:6515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e05bb3ea reply state 00000000e60112b6 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.939199:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135987.939205:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135987.939207:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135987.939211:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135987.939335:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+58:12586:x1876044644704256:12345-192.168.201.31@tcp:36:bash.0 Request processed in 656us (2509us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789135987.939341:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 176 00000020:00080000:1.0:1789135987.939346:0:6515:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789135987.944272:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135987.947835:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135987.948016:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644704384 00000100:00100000:2.0:1789135987.948030:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644704384 00000100:00100000:2.0:1789135987.948146:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 177 00000100:00100000:2.0:1789135987.948158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+58:12586:x1876044644704384:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135987.948191:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135987.948218:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3648 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bb4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.948346:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.948383:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 59 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.948394:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.948441:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 59 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135987.948458:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 59 pid: 14528 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135987.948476:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666804608:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135987.948611:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135987.953940:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44b5680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666804608:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135987.953979:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135987.954578:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135987.954660:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644704512 00000100:00100000:3.0:1789135987.954669:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644704512 00010000:00010000:3.0:1789135987.954733:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 60 pid: 14528 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135987.954778:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:3.0:1789135987.954790:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+60:2391:x1876044644704512:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135987.954807:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135987.954815:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 60 pid: 14528 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.954851:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 60 pid: 14528 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.954920:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3633 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bad expref: 60 pid: 14528 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.954940:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:3.0:1789135987.954948:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.954961:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.954969:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135987.954990:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135987.955066:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+59:2391:x1876044644704512:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 278us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135987.955074:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 100 00010000:00010000:0.0:1789135987.955131:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.955140:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135987.955216:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789135987.955222:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135987.955250:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.955288:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3648 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bb4 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.955305:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bb4 expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135987.955314:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135987.955317:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135987.955319:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5a00, rc 0) 00000100:00100000:0.0:1789135987.955348:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+58:12586:x1876044644704384:12345-192.168.201.31@tcp:101:bash.0 Request processed in 7194us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135987.955365:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 177 00000100:00100000:2.0:1789135987.960622:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135987.960745:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644704768 00000100:00100000:1.0:1789135987.960759:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644704768 00000100:00100000:1.0:1789135987.960841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:1.0:1789135987.960885:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+58:12586:x1876044644704768:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:1.0:1789135987.961927:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+59:12586:x1876044644704768:12345-192.168.201.31@tcp:35:bash.0 Request processed in 1068us (1313us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789135987.961939:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:1.0:1789135988.089104:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135988.089348:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644705024 00000100:00100000:2.0:1789135988.089363:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644705024 00000100:00100000:2.0:1789135988.089448:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 178 00000100:00100000:2.0:1789135988.089460:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+59:12596:x1876044644705024:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135988.089494:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135988.089521:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bbb expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135988.089664:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789135988.089796:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3656 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bbb expref: 61 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.089834:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:2.0:1789135988.089837:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135988.089845:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bbb expref: 61 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.089891:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5e00, rc 0) 00000100:00100000:2.0:1789135988.089977:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+60:12596:x1876044644705024:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 518us (890us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789135988.089985:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 178 00000100:00100000:0.0:1789135988.097941:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135988.098209:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644705152 00000100:00100000:3.0:1789135988.098223:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644705152 00000100:00100000:3.0:1789135988.098317:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 179 00000100:00100000:3.0:1789135988.098329:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+60:12596:x1876044644705152:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:3.0:1789135988.098447:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098470:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098500:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098515:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098523:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098529:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098633:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098645:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098652:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135988.098730:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098746:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098753:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098759:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098777:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135988.098783:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098791:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098806:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:3.0:1789135988.098809:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135988.098815:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098823:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3664 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098839:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098845:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098850:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098967:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135988.098970:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098976:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.098995:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:3.0:1789135988.098998:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135988.099001:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099008:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de366b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099018:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099024:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099030:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099036:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135988.099040:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099046:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099053:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:3.0:1789135988.099055:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135988.099058:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.099064:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3672 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135988.099191:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+60:12596:x1876044644705152:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 862us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135988.099201:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 179 00000100:00100000:0.0:1789135988.122043:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135988.122165:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644705408 00000100:00100000:3.0:1789135988.122179:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644705408 00000100:00100000:3.0:1789135988.122310:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:3.0:1789135988.122324:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+60:12596:x1876044644705408:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135988.123349:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+61:12596:x1876044644705408:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 1018us (1311us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789135988.123364:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000001:00080000:1.0:1789135988.126896:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00010000:00010000:0.0:1789135988.127025:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127043:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127052:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127059:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.127065:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127073:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127103:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90a7e0aa7400) 00010000:00010000:0.0:1789135988.127107:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.127116:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127122:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de348f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127155:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127162:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127190:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127196:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.127199:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127205:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127214:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135988.127217:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.127219:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127225:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3496 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127264:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127272:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127277:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127283:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.127285:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127302:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127312:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3800) 00010000:00010000:0.0:1789135988.127314:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.127318:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127323:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de34d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127341:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127347:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127353:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127357:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.127359:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127364:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127371:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.127373:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.127375:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127390:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de35d8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127401:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127407:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127412:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127418:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167da00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.127421:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127427:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127437:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.127439:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.127442:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127447:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de35fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127458:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127464:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.127475:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135988.128081:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789135988.128121:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7fa4506c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789135988.128127:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7d63ef200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7fa4500c0 00000020:00080000:1.0:1789135988.128130:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7d63ef400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c3f52000 00000020:00080000:1.0:1789135988.128329:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789135988.128431:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789135988.131229:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789135988.131263:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666804736:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789135988.131365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135988.133714:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.133724:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.133739:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.133764:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.133768:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.133774:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.133783:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3641 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135988.138616:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666804736 00000100:00100000:3.0:1789135988.138638:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666804736 00000100:00100000:2.0:1789135988.146033:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789135988.146055:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666804736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789135988.146101:0:8432:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1789135988.146149:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa40c71, atime: 0x6aa40c71, ctime: 0x6aa40c71, blocks: 0x8 00010000:00010000:2.0:1789135988.146158:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.146180:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=436s v=(0 0) 00010000:00010000:2.0:1789135988.146186:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135988.146195:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.146217:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.146229:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.146257:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135988.146290:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135988.146652:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135988.146661:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.146672:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135988.146678:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.146689:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.146738:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.146745:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7e24021/0x559c8745c6de3679 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.146772:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135988.146775:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135988.146776:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135988.147007:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666804736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 958us (15639us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789135988.147017:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1789135988.147288:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7f662a1c0/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789135988.147308:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666804736:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789135988.151360:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789135988.193359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.193504:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644705664 00000100:00100000:1.0:1789135988.193517:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644705664 00000100:00100000:1.0:1789135988.193602:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 180 00000100:00100000:1.0:1789135988.193615:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+18:12599:x1876044644705664:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135988.193651:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135988.193681:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bc2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.193803:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.193823:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.193841:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.193919:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.193927:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.193935:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194078:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3695 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194111:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194118:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3695 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135988.194133:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789135988.194266:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194276:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194285:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194291:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135988.194296:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194305:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194321:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135988.194325:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135988.194331:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194337:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3687 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194354:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194367:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194373:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194379:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135988.194382:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194389:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194397:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7e0aa7b00) 00010000:00010000:1.0:1789135988.194400:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135988.194403:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194409:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de368e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194474:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bc2 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194492:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3695 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bc2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.194501:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135988.194503:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135988.194513:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879e00, rc 0) 00000100:00100000:1.0:1789135988.194645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12599:x1876044644705664:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1031us (1302us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789135988.194657:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 180 00000100:00100000:2.0:1789135988.201478:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135988.201541:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.201743:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644705792 00000100:00100000:1.0:1789135988.201755:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644705792 00000100:00100000:1.0:1789135988.201837:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 181 00000100:00100000:1.0:1789135988.201849:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12599:x1876044644705792:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:1.0:1789135988.201976:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.201998:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202013:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202064:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202072:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202079:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202086:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135988.202091:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202100:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202137:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135988.202140:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135988.202147:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.202155:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135988.202271:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12599:x1876044644705792:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 423us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135988.202280:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 181 00000100:00100000:3.0:1789135988.203113:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644705920 00000100:00100000:3.0:1789135988.203126:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644705920 00000100:00100000:3.0:1789135988.203191:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:3.0:1789135988.203202:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:2391:x1876044644705920:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135988.203218:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135988.203243:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3695 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bc2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.203263:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:3.0:1789135988.203268:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135988.203323:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:2391:x1876044644705920:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 123us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135988.203330:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1789135988.216385:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.216530:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644706176 00000100:00100000:1.0:1789135988.216544:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644706176 00000100:00100000:1.0:1789135988.216627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1789135988.216640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:12599:x1876044644706176:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135988.217019:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12599:x1876044644706176:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 380us (650us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789135988.217029:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1789135988.488680:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.488895:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644706432 00000100:00100000:0.0:1789135988.488910:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644706432 00000100:00100000:0.0:1789135988.489004:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:0.0:1789135988.489016:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12617:x1876044644706432:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:0.0:1789135988.489050:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135988.489076:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bc9 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.489217:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.489235:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.489250:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135988.489283:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789135988.489422:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bc9 expref: 23 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.489444:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bc9 expref: 22 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.489454:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.489457:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789135988.489461:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e400, rc 0) 00000100:00100000:0.0:1789135988.489548:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4c00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12617:x1876044644706432:12345-192.168.201.31@tcp:101:cat.0 Request processed in 533us (885us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789135988.489557:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:2.0:1789135988.539440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.539591:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644706560 00000100:00100000:1.0:1789135988.539604:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644706560 00000100:00100000:1.0:1789135988.539681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:1.0:1789135988.539693:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12618:x1876044644706560:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135988.539735:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135988.539765:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bd0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.539906:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de36c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.539957:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de36c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.539971:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de36c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135988.540030:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789135988.540034:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135988.540056:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de36c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.540089:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd0 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.540110:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de36c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd0 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.540120:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135988.540123:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135988.540128:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167da00, rc 0) 00000100:00100000:1.0:1789135988.540210:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12618:x1876044644706560:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 519us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135988.540217:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:2.0:1789135988.554378:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.554492:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644706944 00000100:00100000:1.0:1789135988.554505:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644706944 00000100:00100000:1.0:1789135988.554583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:1.0:1789135988.554596:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12618:x1876044644706944:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135988.555092:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12618:x1876044644706944:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 495us (728us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789135988.555124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:3.0:1789135988.557391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.557498:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707072 00000100:00100000:0.0:1789135988.557513:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707072 00000100:00100000:0.0:1789135988.557599:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:0.0:1789135988.557611:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4792940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12618:x1876044644707072:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:0.0:1789135988.557632:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789135988.557667:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de364f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bb4 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.557705:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bc9 expref: 23 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.557720:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de354c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b6e expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.557757:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.557764:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135988.557838:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4792940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12618:x1876044644707072:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 229us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.557847:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789135988.567204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.567286:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707200 00000100:00100000:1.0:1789135988.567300:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707200 00000100:00100000:1.0:1789135988.567388:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00100000:1.0:1789135988.567402:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12618:x1876044644707200:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:1.0:1789135988.567620:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.567645:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.567661:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135988.567828:0:14528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789135988.567981:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12618:x1876044644707200:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 580us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135988.567991:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00100000:2.0:1789135988.597290:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.597591:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707328 00000100:00100000:0.0:1789135988.597605:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707328 00000100:00100000:0.0:1789135988.597675:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 185 00000100:00100000:0.0:1789135988.597685:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12620:x1876044644707328:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135988.597722:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135988.597756:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de36d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bd7 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.597852:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.597921:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.597934:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.597953:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.597960:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.597991:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598087:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598102:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598109:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135988.598161:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789135988.598167:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135988.598191:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598206:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598216:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598222:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598360:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598366:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.598371:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598388:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598403:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135988.598407:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.598418:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598425:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de36db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598443:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598449:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598454:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598459:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.598462:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598468:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598542:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135988.598545:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135988.598548:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598566:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de36e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598611:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de36d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 23 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598625:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 22 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.598631:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.598634:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135988.598636:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fe00, rc 0) 00000100:00100000:0.0:1789135988.598983:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12620:x1876044644707328:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1295us (1705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.598993:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 185 00000040:00080000:3.0:1789135988.906204:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135988.906216:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135988.906257:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789135988.906265:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135988.906408:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47930c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666804864:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135988.906528:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135988.916356:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47930c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666804864:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789135988.916777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.916852:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707456 00000100:00100000:0.0:1789135988.916884:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707456 00000100:00100000:0.0:1789135988.916936:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 186 00000100:00100000:0.0:1789135988.916946:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644707456:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135988.916978:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135988.917087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644707456:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 142us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.917096:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 186 00000100:00100000:2.0:1789135988.935098:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.935186:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707584 00000100:00100000:1.0:1789135988.935202:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707584 00000100:00100000:1.0:1789135988.935279:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 187 00000100:00100000:1.0:1789135988.935291:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644707584:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789135988.935377:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935397:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935412:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935444:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935452:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935470:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935501:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935511:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935518:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135988.935569:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789135988.935574:0:14528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135988.935589:0:14528:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935601:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935608:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935615:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935632:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135988.935636:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935644:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935657:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:1.0:1789135988.935660:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135988.935665:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935670:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de36f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935705:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935712:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935719:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935723:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135988.935726:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935731:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935750:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff90a7e0aa7b00) 00010000:00010000:1.0:1789135988.935753:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135988.935757:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935763:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de36f7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935782:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935788:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935794:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935798:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135988.935800:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935806:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935813:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135988.935815:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135988.935818:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.935823:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de36fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135988.936117:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644707584:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 827us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135988.936126:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 187 00000100:00100000:2.0:1789135988.943418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.943492:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707840 00000100:00100000:0.0:1789135988.943529:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707840 00000100:00100000:0.0:1789135988.943612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 188 00000100:00100000:0.0:1789135988.943624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644707840:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135988.943644:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135988.943665:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3705 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bde expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.943801:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.943816:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.943836:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135988.943849:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789135988.943992:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944001:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944009:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944015:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135988.944020:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944030:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944056:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135988.944059:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789135988.944064:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944071:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de370c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944120:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3705 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bde expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944132:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:0.0:1789135988.944134:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135988.944139:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3705 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bde expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.944149:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fa00, rc 0) 00000100:00100000:0.0:1789135988.944219:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12631:x1876044644707840:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 596us (818us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789135988.944229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 188 00000100:00100000:3.0:1789135988.946255:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.946699:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644707968 00000100:00100000:0.0:1789135988.946712:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644707968 00000100:00100000:0.0:1789135988.946799:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 189 00000100:00100000:0.0:1789135988.946811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12631:x1876044644707968:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135988.946899:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135988.947065:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12631:x1876044644707968:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 255us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.947091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 189 00000100:00100000:0.0:1789135988.950539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135988.951244:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644708224 00000100:00100000:1.0:1789135988.951260:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644708224 00000100:00100000:1.0:1789135988.951338:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 190 00000100:00100000:1.0:1789135988.951347:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4778780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12631:x1876044644708224:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135988.951368:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135988.951371:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789135988.951398:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de36c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd0 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.951418:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135988.951423:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135988.951436:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de371a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08be5 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789135988.951824:0:14529:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789135988.951980:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3721 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.951993:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.952002:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3721 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.952049:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de371a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08be5 expref: 25 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.952078:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08be5 expref: 24 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135988.952086:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7e0aa7b00) 00010000:00010000:1.0:1789135988.952089:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135988.952092:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135988.952168:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4778780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12631:x1876044644708224:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 821us (1642us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789135988.952175:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 190 00000100:00100000:1.0:1789135988.963048:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135988.963145:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644708480 00000100:00100000:3.0:1789135988.963161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644708480 00000100:00100000:3.0:1789135988.963248:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:3.0:1789135988.963260:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12631:x1876044644708480:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135988.963337:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135988.963376:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3721 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08be5 expref: 24 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963399:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7e0aa7b00) 00010000:00010000:3.0:1789135988.963415:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135988.963448:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963465:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963478:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963496:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963524:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963532:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963595:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963603:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963612:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963619:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135988.963624:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963633:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963642:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:3.0:1789135988.963646:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135988.963650:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963658:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de372f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963670:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963684:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963704:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963710:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135988.963714:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963721:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963730:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xfa0563be (ffff90a7fa7d3e00) 00010000:00010000:3.0:1789135988.963733:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135988.963735:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.963742:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de3736 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xfa0563be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135988.963881:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12631:x1876044644708480:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 598us (822us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789135988.963890:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 191 00010000:00010000:3.0:1789135988.968124:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789135988.969003:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.969103:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644708608 00000100:00100000:0.0:1789135988.969116:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644708608 00000100:00100000:0.0:1789135988.969190:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:0.0:1789135988.969202:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12631:x1876044644708608:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135988.969230:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135988.969477:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de373d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.969530:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.969549:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.969562:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.969726:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de373d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.969749:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.969759:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135988.969763:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789135988.969767:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e400, rc 0) 00000100:00100000:0.0:1789135988.971351:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ec30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12631:x1876044644708608:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2136us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.971364:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:2.0:1789135988.978998:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135988.979186:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644708864 00000100:00100000:3.0:1789135988.979200:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644708864 00000100:00100000:3.0:1789135988.979287:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:3.0:1789135988.979298:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12631:x1876044644708864:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135988.979445:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.979467:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.979483:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789135988.979720:0:14529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789135988.979732:0:14529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437098876667ns, next at 438098873092ns, rc = 0 00000004:00010000:3.0:1789135988.979789:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a3b46f0c reply state 0000000034f0f9f1 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.979806:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135988.979815:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:3.0:1789135988.979818:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789135988.979822:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135988.979998:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12631:x1876044644708864:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 698us (1015us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789135988.980010:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:2.0:1789135988.983903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.984016:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644708992 00000100:00100000:0.0:1789135988.984031:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644708992 00000100:00100000:0.0:1789135988.984117:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:0.0:1789135988.984130:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12631:x1876044644708992:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135988.984164:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135988.984195:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bf3 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.984289:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 27 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.984306:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 27 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135988.984330:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135988.984333:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135988.984339:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fa00, rc 0) 00000100:00100000:0.0:1789135988.984416:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12631:x1876044644708992:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 289us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135988.984423:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:2.0:1789135988.991383:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135988.991546:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644709120 00000100:00100000:0.0:1789135988.991559:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644709120 00000100:00100000:0.0:1789135988.991657:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:0.0:1789135988.991670:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2392:x1876044644709120:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789135988.992142:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f68892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644709120:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 473us (772us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789135988.992229:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00080000:1.0:1789135988.997485:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789135989.006402:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135989.006465:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644709376 00000100:00100000:2.0:1789135989.006478:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644709376 00000100:00080000:3.0:1789135989.006579:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135989.006584:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:2.0:1789135989.006598:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12631:x1876044644709376:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135989.006986:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12631:x1876044644709376:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 389us (600us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789135989.006994:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:3.0:1789135989.010278:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135989.010414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644709632 00000100:00100000:2.0:1789135989.010427:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644709632 00000100:00100000:2.0:1789135989.010511:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 195 00000100:00100000:2.0:1789135989.010524:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12631:x1876044644709632:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135989.010673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12631:x1876044644709632:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 151us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.010682:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 195 00000100:00100000:2.0:1789135989.014030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135989.014102:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644709760 00000100:00100000:3.0:1789135989.014116:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644709760 00000100:00100000:3.0:1789135989.014200:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:3.0:1789135989.014214:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12631:x1876044644709760:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135989.014269:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135989.014297:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3759 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08bfa expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.014392:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3760 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.014411:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.014426:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135989.014485:0:14529:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789135989.014512:0:14529:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3760 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.014544:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3759 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bfa expref: 30 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.014563:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3760 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bfa expref: 29 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.014572:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:3.0:1789135989.014576:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789135989.014581:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafc00, rc 0) 00000100:00100000:3.0:1789135989.014662:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+29:12631:x1876044644709760:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 451us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135989.014670:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:2.0:1789135989.018560:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135989.018637:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644709888 00000100:00100000:3.0:1789135989.018651:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644709888 00000100:00100000:3.0:1789135989.018755:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:3.0:1789135989.018766:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644709888:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135989.018794:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135989.018826:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c01 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789135989.018879:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c74, blocks: 0x0 00010000:00010000:3.0:1789135989.018905:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1789135989.018911:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135989.018923:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.018947:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.018963:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caec00, rc 0) 00000100:00100000:3.0:1789135989.019045:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644709888:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 281us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135989.019053:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:2.0:1789135989.022748:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135989.024983:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644710144 00000100:00100000:0.0:1789135989.025001:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644710144 00000100:00100000:0.0:1789135989.025070:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 197 00000100:00100000:0.0:1789135989.025083:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+29:12631:x1876044644710144:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135989.025200:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+29:12631:x1876044644710144:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 120us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.025208:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 197 00000100:00100000:0.0:1789135989.044734:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.045987:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644710272 00000100:00100000:1.0:1789135989.046006:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644710272 00000100:00100000:1.0:1789135989.046098:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1789135989.046110:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:12631:x1876044644710272:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135989.046136:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135989.046163:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c08 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.046213:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.046224:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135989.046230:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135989.046236:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.046297:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.046315:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.046333:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666804992:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135989.046473:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c381e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135989.051878:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666804992:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135989.051937:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.051967:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878c00, rc 0) 00000100:00100000:1.0:1789135989.052063:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+9:12631:x1876044644710272:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 5953us (7342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.052075:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:3.0:1789135989.052218:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.052398:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644710400 00000100:00100000:1.0:1789135989.052407:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644710400 00010000:00010000:1.0:1789135989.052448:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.052489:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:1.0:1789135989.052501:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2392:x1876044644710400:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135989.052535:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135989.052563:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.052576:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.052604:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3767 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c01 expref: 9 pid: 8432 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.052620:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135989.052625:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789135989.052634:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.052646:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.052682:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.052709:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1876044666805120:192.168.201.31@tcp:105: 00000100:00100000:1.0:1789135989.052791:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c381e840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135989.058018:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6500:1876044666805120:192.168.201.31@tcp:105: 00010000:00010000:1.0:1789135989.058058:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135989.058190:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644710400:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 5690us (5983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.058203:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:0.0:1789135989.069491:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.070183:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644710528 00000100:00100000:1.0:1789135989.070198:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644710528 00002000:00100000:1.0:1789135989.070289:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90a6c477ad00 x1876044644710528/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:420/0 lens 504/0 e 0 to 0 dl 1789136000 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135989.070303:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c477ad00 with x1876044644710528 ext(0->8) 00002000:00010000:1.0:1789135989.070312:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c477ad00 00000100:00100000:1.0:1789135989.070357:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1789135989.070369:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c477ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644710528:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789135989.071547:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c477ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2391:x1876044644710528:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 1170us (2063us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789135989.071562:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00002000:00100000:1.0:1789135989.071573:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90a6c477ad00 x1876044644710528/t4294967315(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:420/0 lens 504/448 e 0 to 0 dl 1789136000 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135989.071582:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c477ad00 with x1876044644710528 ext(0->8) 00002000:00010000:1.0:1789135989.071586:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c477ad00 00000100:00100000:0.0:1789135989.075746:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.076558:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644710656 00000100:00100000:1.0:1789135989.076573:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644710656 00000100:00100000:1.0:1789135989.076660:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:1.0:1789135989.076673:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4779e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+29:12631:x1876044644710656:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789135989.086060:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1789135989.086087:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789135989.086137:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789135989.086195:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789135989.086209:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789135989.086406:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4779e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12631:x1876044644710656:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 9726us (10666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.086420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:3.0:1789135989.086464:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666805248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789135989.086543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789135989.086637:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.086653:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.086662:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.086670:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135989.086675:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.086696:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.086734:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135989.086738:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135989.086745:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.086753:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de374b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.086788:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666805248 00000100:00100000:1.0:1789135989.086798:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666805248 00000100:00100000:1.0:1789135989.086877:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789135989.086886:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666805248:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789135989.087015:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789135989.087502:0:8536:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789135989.087507:0:8536:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789135988 00002000:00010000:1.0:1789135989.087509:0:8536:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789135989.087512:0:8536:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789135988 -> 1789135988 00002000:00010000:1.0:1789135989.087519:0:8536:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789135989.087584:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666805248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 697us (1040us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789135989.087594:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789135989.088843:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.089166:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644710784 00000100:00100000:1.0:1789135989.089178:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644710784 00000100:00100000:1.0:1789135989.089251:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:1.0:1789135989.089262:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2392:x1876044644710784:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1789135989.091704:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a6c4490b40/2, rc 0, transno 4294967316 00000100:00100000:2.0:1789135989.091728:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4490b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666805248:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789135989.092978:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1789135989.092999:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1789135989.093617:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644710784:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 4348us (4774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.093632:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:3.0:1789135989.098959:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666805376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789135989.099073:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.099235:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666805376 00000100:00100000:0.0:1789135989.099246:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666805376 00000100:00100000:0.0:1789135989.099325:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789135989.099337:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666805376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135989.099386:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789135989.099457:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666805376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.099464:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789135989.099615:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666805376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135989.100986:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135989.101121:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644711040 00000100:00100000:3.0:1789135989.101182:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644711040 00000100:00100000:3.0:1789135989.101249:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 199 00000100:00100000:3.0:1789135989.101260:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfffd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12631:x1876044644711040:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135989.101323:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135989.101360:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de3760 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bfa expref: 20 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.101379:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:3.0:1789135989.101386:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135989.101425:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.101442:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.101454:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135989.101617:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009a4d9cd7 reply state 00000000d2b2d8c3 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.101631:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.101647:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:3.0:1789135989.101650:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135989.101653:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135989.101884:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfffd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12631:x1876044644711040:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 624us (904us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789135989.101893:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 199 00000100:00100000:0.0:1789135989.121384:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.121446:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644711168 00000100:00100000:1.0:1789135989.121462:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644711168 00000100:00100000:1.0:1789135989.121742:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:1.0:1789135989.121768:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644711168:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789135989.122043:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789135989.122047:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789135988 -> 1789135987 00002000:00010000:1.0:1789135989.122051:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789135985 00002000:00010000:1.0:1789135989.122053:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789135988 -> 1789135987 00002000:00010000:1.0:1789135989.122056:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789135989.122142:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644711168:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 376us (773us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789135989.122150:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:2.0:1789135989.133806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135989.134356:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644711424 00000100:00100000:2.0:1789135989.134366:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644711424 00000100:00100000:2.0:1789135989.134425:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 200 00000100:00100000:2.0:1789135989.134434:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+21:12631:x1876044644711424:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789135989.134501:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.134519:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.134548:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.134582:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.134595:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 21 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.134610:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4518000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666805504:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135989.134714:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789135989.146900:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.146979:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644711552 00000100:00100000:1.0:1789135989.146991:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644711552 00010000:00010000:1.0:1789135989.147053:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 22 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.147125:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:1.0:1789135989.147315:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4545a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+22:2391:x1876044644711552:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135989.147336:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135989.147345:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 22 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.147362:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 22 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.147392:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:1.0:1789135989.147399:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.147427:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.147436:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.147610:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135989.147681:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4545a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+22:2391:x1876044644711552:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 370us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.147703:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00010000:00010000:2.0:1789135989.148744:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bec expref: 21 pid: 6517 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.148769:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4518000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666805504:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135989.148798:0:8299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148809:0:8299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148815:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148894:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148902:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148927:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148935:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135989.148940:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148950:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148969:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:2.0:1789135989.148972:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789135989.148977:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.148984:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de377c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.149055:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12631:x1876044644711424:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 14619us (15259us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789135989.149066:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 200 00000100:00100000:2.0:1789135989.155933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135989.156108:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644711680 00000100:00100000:3.0:1789135989.156122:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644711680 00000100:00100000:3.0:1789135989.156203:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:3.0:1789135989.156215:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2390:x1876044644711680:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789135989.156278:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.156305:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.156314:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135989.156320:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135989.156327:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.156373:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.156390:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 8 pid: 8430 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135989.156435:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4491a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666805632:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135989.156558:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135989.159428:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4491a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666805632:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135989.159468:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.162112:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135989.166061:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644711808 00000100:00100000:3.0:1789135989.166080:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644711808 00010000:00010000:3.0:1789135989.166142:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 9 pid: 8430 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135989.166202:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:3.0:1789135989.166214:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644711808:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135989.166234:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135989.166260:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 9 pid: 8430 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.166276:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 9 pid: 8430 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.166305:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a915f250/0x559c8745c6de376e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c08 expref: 9 pid: 8430 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.166324:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135989.166329:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135989.166335:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.166361:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.166407:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135989.166486:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644711808:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 273us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135989.166494:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 103 00010000:00010000:2.0:1789135989.166700:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166711:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166748:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166757:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166765:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166772:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135989.166777:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166785:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166801:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.166808:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3783 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.166909:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644711680:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 10696us (10992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.166919:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:2.0:1789135989.182057:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135989.184696:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644712064 00000100:00100000:0.0:1789135989.184716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644712064 00000100:00100000:0.0:1789135989.184814:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 201 00000100:00100000:0.0:1789135989.184828:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12631:x1876044644712064:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789135989.184971:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.184994:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 20 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.185023:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.185068:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 20 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.185084:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 20 pid: 14528 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135989.185100:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666805760:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135989.185231:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135989.190877:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666805760:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135989.190920:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.191261:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.191417:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644712192 00000100:00100000:1.0:1789135989.191426:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644712192 00010000:00010000:1.0:1789135989.191479:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 21 pid: 14528 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.191532:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:1.0:1789135989.191544:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfebb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+21:2391:x1876044644712192:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135989.191564:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135989.191592:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 21 pid: 14528 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.191606:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 21 pid: 14528 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.191635:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de35d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b91 expref: 21 pid: 14528 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.191654:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135989.191660:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.191672:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.191682:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.191730:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135989.191796:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfebb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+20:2391:x1876044644712192:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 253us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.191805:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 104 00010000:00010000:3.0:1789135989.192228:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.192237:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.192485:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.192502:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 20 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.192512:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.192557:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 20 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135989.192575:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 20 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135989.192611:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4490780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666805888:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789135989.192712:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e076c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135989.205970:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4490780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666805888:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135989.206011:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.206575:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135989.206987:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644712320 00000100:00100000:0.0:1789135989.206998:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644712320 00010000:00010000:0.0:1789135989.207052:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 21 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135989.207094:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 105 00000100:00100000:0.0:1789135989.207104:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+21:2392:x1876044644712320:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135989.207122:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135989.207129:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 21 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.207154:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 21 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.207183:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3752 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bf3 expref: 21 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.207198:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135989.207203:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.207215:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.207224:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.207259:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135989.207330:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+20:2392:x1876044644712320:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 226us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.207338:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 105 00010000:00010000:2.0:1789135989.209677:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.209711:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135989.210026:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789135989.210183:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789135989.210222:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789135989.210333:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4519a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1876044666806016:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789135989.210428:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135989.210488:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789135989.210746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806016 00000100:00100000:1.0:1789135989.210757:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806016 00000100:00100000:1.0:1789135989.210834:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789135989.210846:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1876044666806016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789135989.210976:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1876044666806016:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.210996:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789135989.211047:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1789135989.211054:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a6c4490b40, transno 4294967316 00000100:00100000:1.0:1789135989.211071:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4519a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1876044666806016:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789135989.211234:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1789135989.211297:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1876044666806144:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789135989.211332:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135989.211349:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa4506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789135989.211520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806144 00000100:00100000:0.0:1789135989.211525:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806144 00000100:00100000:0.0:1789135989.211551:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789135989.211558:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1876044666806144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789135989.211665:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1876044666806144:12345-0@lo:1000:mdt00_002.0 Request processed in 107us (332us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789135989.211672:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789135989.211879:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1876044666806144:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789135989.211932:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.211944:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.211952:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.211959:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135989.211964:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.211973:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.211994:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:1.0:1789135989.211997:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135989.212003:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212018:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3791 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212047:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212053:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212059:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212065:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167de00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135989.212068:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212074:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212084:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135989.212086:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135989.212089:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212095:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de36cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212123:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212141:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 23 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212156:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212187:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 23 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.212203:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 23 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.212216:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666806272:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135989.212422:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa4506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135989.228215:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135989.228320:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644712448 00000100:00100000:0.0:1789135989.228336:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644712448 00010000:00010000:0.0:1789135989.228392:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 24 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135989.228447:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:0.0:1789135989.228458:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+24:2391:x1876044644712448:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135989.228479:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135989.228486:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 24 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.228501:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 24 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.228532:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789135989.228539:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.228551:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.228561:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.228587:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135989.228646:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de36e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08bd7 expref: 24 pid: 8299 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135989.228652:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+24:2391:x1876044644712448:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 196us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.228661:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:1.0:1789135989.228667:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1876044666806272:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135989.228704:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228714:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228719:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228732:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228738:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228763:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228769:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135989.228773:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228781:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228791:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135989.228794:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135989.228798:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228805:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3798 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228815:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228821:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228827:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228832:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135989.228835:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228879:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228891:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789135989.228894:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135989.228899:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.228905:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de378a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135989.229099:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644712064:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 44268us (47052us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789135989.229109:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 201 00000020:00080000:1.0:1789135989.229113:0:6517:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789135989.229475:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135989.229488:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135989.230002:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789135989.230014:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135989.235106:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135989.235302:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644712704 00000100:00100000:1.0:1789135989.235316:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644712704 00000100:00100000:1.0:1789135989.235394:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:1.0:1789135989.235406:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12631:x1876044644712704:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789135989.235798:0:6519:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789135989.235842:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1789135989.236039:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.236060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.236075:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.236106:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.236113:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.236119:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135989.236144:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789135989.236263:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12631:x1876044644712704:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 857us (1169us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789135989.236273:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000020:00080000:1.0:1789135989.236280:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789135989.238414:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135989.238433:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.238445:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135989.238450:0:13980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.238462:0:13980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.238486:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135989.238490:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789135989.238495:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.238502:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de379f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.238517:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135989.238519:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135989.238521:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135989.608598:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666806400:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.608691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.608750:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c45452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666806912:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.608778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.608799:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c45461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666807424:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.608841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.608888:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789135989.608895:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666806528:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.608995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.609018:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c45443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666807040:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.609040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.609059:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4546940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666807552:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.609085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135989.609297:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806400 00000100:00100000:1.0:1789135989.609305:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806400 00000100:00100000:1.0:1789135989.609362:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789135989.609373:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666806400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.610062:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806912 00000100:00100000:0.0:1789135989.610068:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806912 00000100:00100000:0.0:1789135989.610122:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807424 00000100:00100000:0.0:1789135989.610125:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807424 00000100:00100000:0.0:1789135989.610140:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806528 00000100:00100000:0.0:1789135989.610142:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806528 00000100:00100000:0.0:1789135989.610152:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807040 00000100:00100000:0.0:1789135989.610154:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807040 00000100:00100000:0.0:1789135989.610167:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807552 00000100:00100000:0.0:1789135989.610169:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807552 00000100:00100000:0.0:1789135989.610181:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789135989.610187:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666806912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.611459:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666806656:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.611517:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135989.611544:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666807168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.611569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135989.611592:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4544780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666807680:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.611612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135989.611634:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789135989.611641:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666806784:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.611664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135989.611700:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666807296:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.611722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135989.611761:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806656 00000100:00100000:3.0:1789135989.611768:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806656 00000100:00100000:3.0:1789135989.611805:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789135989.611815:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666807424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135989.611966:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807168 00000100:00100000:2.0:1789135989.611969:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807168 00000100:00100000:2.0:1789135989.612000:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807680 00000100:00100000:2.0:1789135989.612003:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807680 00000100:00100000:2.0:1789135989.612018:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807296 00000100:00100000:2.0:1789135989.612021:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807296 00000100:00100000:2.0:1789135989.612033:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135989.612040:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666807168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135989.612078:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666807168:12345-0@lo:400:kworker.0 Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.612086:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789135989.612184:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135989.612195:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666807680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135989.612225:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666807680:12345-0@lo:400:kworker.0 Request processed in 33us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.612244:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789135989.612257:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789135989.612263:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666807296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135989.612292:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666807296:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.612297:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789135989.614380:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666806400:12345-0@lo:400:kworker.0 Request processed in 5001us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.614396:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789135989.614489:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789135989.614503:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.617542:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666806912:12345-0@lo:400:kworker.0 Request processed in 7344us (8752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.617558:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789135989.617600:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789135989.617617:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666807040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.617704:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666807040:12345-0@lo:400:kworker.0 Request processed in 96us (8663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.617728:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789135989.617742:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789135989.617749:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666807552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.617779:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666807552:12345-0@lo:400:kworker.0 Request processed in 31us (8693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.617785:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789135989.617795:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789135989.617801:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666806656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.617828:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666806656:12345-0@lo:400:kworker.0 Request processed in 28us (6312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.617833:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1789135989.618086:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666807424:12345-0@lo:400:kworker.0 Request processed in 6269us (9240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135989.618093:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789135989.618140:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666806784 00000100:00100000:3.0:1789135989.618147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666806784 00000100:00100000:3.0:1789135989.618201:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789135989.618207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666806784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.618243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666806784:12345-0@lo:400:kworker.0 Request processed in 37us (6578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135989.618249:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789135989.618281:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c451a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666807808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135989.618318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135989.618358:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807808 00000100:00100000:3.0:1789135989.618362:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807808 00000100:00100000:3.0:1789135989.618385:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789135989.618390:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666807808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135989.618412:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135989.618458:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666807808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135989.618463:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789135989.618502:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c451a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666807808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135989.618529:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4547c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666806784:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.618539:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4546580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666807296:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.618549:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666806656:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.618560:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666807168:0@lo:400:kworker.0 00000100:00100000:3.0:1789135989.618572:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4544780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666807680:0@lo:400:kworker.0 00000100:00080000:3.0:1789135989.618624:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789135989.618629:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789135989.618632:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789135989.618642:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789135989.623187:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789135989.623220:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666807936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789135989.624115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135989.625500:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666807936 00000100:00100000:0.0:1789135989.625513:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666807936 00000100:00100000:0.0:1789135989.625574:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789135989.625584:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666807936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135989.625613:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135989.625699:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666807936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135989.625707:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789135989.625761:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666807936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135989.631758:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666806528:12345-0@lo:400:kworker.0 Request processed in 17253us (22755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135989.631773:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1789135989.632401:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4547840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666806528:0@lo:400:kworker.0 00010000:00080000:0.0:1789135989.632422:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c45443c0 x1876044666807040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135989.632432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c45443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666807040:0@lo:400:kworker.0 00010000:00080000:0.0:1789135989.632457:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4546940 x1876044666807552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135989.632466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4546940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666807552:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.632477:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666806400:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.632488:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c45452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666806912:0@lo:400:kworker.0 00000100:00100000:0.0:1789135989.632498:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c45461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666807424:0@lo:400:kworker.0 00000040:00080000:3.0:1789135989.695649:0:15319:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135989.695659:0:15319:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135989.696710:0:15319:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789135989.696721:0:15319:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135989.949781:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135989.949904:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644712960 00000100:00100000:0.0:1789135989.949915:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644712960 00000100:00100000:0.0:1789135989.949971:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:0.0:1789135989.949981:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+24:12641:x1876044644712960:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135989.950006:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135989.950028:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de37a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c0f expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.950135:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de37ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.950152:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de37ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.950165:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de37ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135989.950175:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789135989.950277:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de37a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c0f expref: 27 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.950308:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de37ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c0f expref: 26 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135989.950317:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135989.950320:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789135989.950323:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e800, rc 0) 00000100:00100000:0.0:1789135989.950391:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12641:x1876044644712960:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 411us (619us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789135989.950398:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:0.0:1789135989.964311:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135989.965109:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644713088 00000100:00100000:2.0:1789135989.965119:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644713088 00000100:00100000:2.0:1789135989.965184:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:2.0:1789135989.965195:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12641:x1876044644713088:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1789135989.965274:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965291:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965303:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965319:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965327:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965334:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965416:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965425:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965432:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135989.965481:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965494:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965502:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965510:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965516:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135989.965520:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965528:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965540:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135989.965543:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135989.965548:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965560:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de37bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965573:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965579:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965584:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965590:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135989.965593:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965599:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965606:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7c3600) 00010000:00010000:2.0:1789135989.965609:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135989.965612:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965617:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965630:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965635:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965647:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965652:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135989.965654:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965660:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965678:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7c3000) 00010000:00010000:2.0:1789135989.965681:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135989.965685:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135989.965690:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de37c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135989.965776:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12641:x1876044644713088:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 582us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135989.965784:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 203 00010000:00010000:0.0:1789135989.992728:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135990.055018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135990.055149:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644713344 00000100:00100000:3.0:1789135990.055160:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644713344 00000100:00100000:3.0:1789135990.055224:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:3.0:1789135990.055235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12644:x1876044644713344:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789135990.055256:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.055278:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de37d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c16 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055360:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055375:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055387:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055403:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055411:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055417:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055561:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055579:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055586:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135990.055597:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789135990.055690:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055698:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055704:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055709:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135990.055714:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055721:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055732:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:3.0:1789135990.055736:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135990.055740:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055747:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de37d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055757:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055768:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055774:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055779:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135990.055782:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055789:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055797:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7d3700) 00010000:00010000:3.0:1789135990.055800:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135990.055803:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055810:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de37de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055876:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de37d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055892:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.055899:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:3.0:1789135990.055902:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135990.056518:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae400, rc 0) 00000100:00100000:3.0:1789135990.056594:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12644:x1876044644713344:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1358us (1586us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789135990.056604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:1.0:1789135990.063164:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.063242:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644713472 00000100:00100000:2.0:1789135990.063252:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644713472 00000100:00100000:2.0:1789135990.063318:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 205 00000100:00100000:2.0:1789135990.063329:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12644:x1876044644713472:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1789135990.063398:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063416:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063450:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063486:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063493:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063499:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063505:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135990.063509:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063516:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063528:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:2.0:1789135990.063531:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135990.063535:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.063541:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de37f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.063619:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12644:x1876044644713472:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 291us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.063627:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 205 00000100:00100000:0.0:1789135990.067079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.067344:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644713728 00000100:00100000:1.0:1789135990.067354:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644713728 00000100:00100000:1.0:1789135990.067516:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:1.0:1789135990.067526:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12644:x1876044644713728:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1789135990.067745:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+29:12644:x1876044644713728:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 220us (675us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789135990.067753:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:1.0:1789135990.120072:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666808064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135990.120149:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135990.120227:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666808064 00000100:00100000:3.0:1789135990.120236:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666808064 00000100:00100000:3.0:1789135990.120283:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789135990.120293:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4546940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666808064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789135990.120318:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1789135990.120331:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789135990.120343:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135990.120366:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4546940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666808064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.120370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135990.120374:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789135990.120388:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666808192 00000100:00100000:3.0:1789135990.120391:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666808192 00000100:00100000:3.0:1789135990.120408:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789135990.120414:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666808192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789135990.120436:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1789135990.120622:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666808192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 207us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.120629:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789135990.120658:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4544b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666808064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789135990.120707:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4519a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789135990.127970:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135990.128108:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644713984 00000100:00100000:0.0:1789135990.128118:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644713984 00000100:00100000:0.0:1789135990.128184:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:0.0:1789135990.128194:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+29:12176:x1876044644713984:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135990.128217:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135990.128238:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de37fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c1d expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.128346:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.128360:0:14528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.128385:0:14528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.128419:0:14528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135990.128434:0:14528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 30 pid: 6517 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.128459:0:14528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666808320:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135990.128556:0:14528:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789135990.135448:0:14528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14528:1876044666808320:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789135990.135481:0:14528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.136457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.136554:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644714112 00000100:00100000:2.0:1789135990.136561:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644714112 00010000:00010000:2.0:1789135990.136601:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 31 pid: 6517 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.136641:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:2.0:1789135990.136651:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+31:2391:x1876044644714112:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135990.136699:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135990.136706:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 31 pid: 6517 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.136718:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 31 pid: 6517 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.136741:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae400/0x559c8745c6de37e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c16 expref: 31 pid: 6517 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.136756:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:2.0:1789135990.136761:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.136771:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.136795:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.136821:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135990.136925:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+30:2391:x1876044644714112:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 274us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.136934:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00010000:00010000:3.0:1789135990.142417:0:14528:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.142478:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135990.142503:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789135990.142649:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de37fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 31 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.142681:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 30 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.142691:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:3.0:1789135990.142695:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789135990.142698:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f400, rc 0) 00000100:00100000:3.0:1789135990.142762:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+30:12176:x1876044644713984:12345-192.168.201.31@tcp:101:bash.0 Request processed in 14569us (14799us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789135990.142771:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:0.0:1789135990.154227:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.154394:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644714240 00000100:00100000:1.0:1789135990.154404:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644714240 00000100:00100000:1.0:1789135990.154474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:1.0:1789135990.154485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+30:12176:x1876044644714240:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789135990.154510:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135990.154533:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de380f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c24 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.154572:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3816 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.154587:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.154598:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3816 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.154747:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de380f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c24 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.154765:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3816 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c24 expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.154773:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.154775:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135990.154779:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879200, rc 0) 00000100:00100000:1.0:1789135990.154849:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+31:12176:x1876044644714240:12345-192.168.201.31@tcp:101:bash.0 Request processed in 366us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135990.154885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:0.0:1789135990.170318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.172094:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644714496 00000100:00100000:2.0:1789135990.172110:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644714496 00000100:00100000:2.0:1789135990.172182:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 208 00000100:00100000:2.0:1789135990.172193:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+31:12176:x1876044644714496:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:2.0:1789135990.173559:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.173584:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.173598:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135990.173690:0:14529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1789135990.174589:0:14529:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004eb596d9 reply state 00000000bd5bce8f transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.174610:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.174619:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:2.0:1789135990.174622:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789135990.174647:0:14529:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789135990.175068:0:14529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1789135990.175268:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+35:12176:x1876044644714496:12345-192.168.201.31@tcp:36:bash.0 Request processed in 3071us (4955us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789135990.175278:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 208 00000020:00080000:2.0:1789135990.175284:0:14529:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789135990.181312:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.181415:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644714624 00000100:00100000:2.0:1789135990.181436:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644714624 00000100:00100000:2.0:1789135990.181497:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 209 00000100:00100000:2.0:1789135990.181508:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+35:12176:x1876044644714624:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135990.181532:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135990.181553:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3824 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c2b expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.181610:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3824 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c2b expref: 36 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.181627:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3824 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c2b expref: 36 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.181646:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:2.0:1789135990.181649:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789135990.181653:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4e00, rc 0) 00000100:00100000:2.0:1789135990.182012:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+36:12176:x1876044644714624:12345-192.168.201.31@tcp:101:bash.0 Request processed in 505us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.182020:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 209 00000100:00100000:0.0:1789135990.191407:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.191583:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644714752 00000100:00100000:2.0:1789135990.191592:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644714752 00000100:00100000:2.0:1789135990.191681:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:2.0:1789135990.191707:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:12176:x1876044644714752:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135990.191736:0:8536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135990.191759:0:8536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c32 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135990.191785:0:8536:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa40c73, atime: 0x6aa40c71, ctime: 0x6aa40c73, blocks: 0x8 00010000:00010000:2.0:1789135990.191823:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1789135990.191828:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135990.191838:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.191891:0:8536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.191916:0:8536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5e00, rc 0) 00000100:00100000:2.0:1789135990.191978:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:12176:x1876044644714752:12345-192.168.201.31@tcp:101:bash.0 Request processed in 273us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.191985:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00080000:3.0:1789135990.192642:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789135990.197423:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.197681:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644714880 00000100:00100000:2.0:1789135990.197691:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644714880 00002000:00010000:2.0:1789135990.198364:0:8437:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789135990.198371:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7c86dd2c0 with x1876044644714880 ext(0->18446744073709551615) 00002000:00010000:2.0:1789135990.198386:0:8437:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a7c86dd2c0. 00000100:00100000:2.0:1789135990.199115:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1789135990.199135:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2390:x1876044644714880:12345-192.168.201.31@tcp:10:bash.0 00002000:00010000:2.0:1789135990.199422:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789135990.199445:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789135987 -> 1789135989 00002000:00010000:2.0:1789135990.199448:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789135985 -> 1789135985 00002000:00010000:2.0:1789135990.199450:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789135987 -> 1789135989 00002000:00010000:2.0:1789135990.199452:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789135990.199522:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2390:x1876044644714880:12345-192.168.201.31@tcp:10:bash.0 Request processed in 396us (2106us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789135990.199531:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00002000:00010000:2.0:1789135990.199536:0:8437:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789135990.199539:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7c86dd2c0 with x1876044644714880 ext(0->18446744073709551615) 00002000:00010000:2.0:1789135990.199547:0:8437:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a7c86dd2c0. 00000100:00100000:0.0:1789135990.352603:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.352801:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644715008 00000100:00100000:1.0:1789135990.352826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644715008 00000100:00100000:1.0:1789135990.352922:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 210 00000100:00100000:1.0:1789135990.352933:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+36:12659:x1876044644715008:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:1.0:1789135990.353014:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353033:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353046:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353063:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353091:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353099:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353189:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353199:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353206:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135990.353263:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353276:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353283:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353291:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353298:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.353304:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353312:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353332:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135990.353335:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.353340:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353347:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353361:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353367:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353373:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353379:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.353381:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353388:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353396:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135990.353398:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.353401:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353407:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de3839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353437:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353444:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353449:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353454:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.353457:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353463:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353470:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.353473:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.353475:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.353496:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135990.353577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+36:12659:x1876044644715008:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 645us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135990.353585:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 210 00000100:00100000:2.0:1789135990.463255:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.463363:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644715264 00000100:00100000:1.0:1789135990.463373:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644715264 00000100:00100000:1.0:1789135990.463432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:1.0:1789135990.463458:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+36:12662:x1876044644715264:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135990.463477:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135990.463498:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c39 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463576:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463592:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463604:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463619:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463626:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463632:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463748:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de385c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463758:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de385c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463766:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de385c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135990.463786:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789135990.463924:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463933:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463939:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463946:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.463950:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463959:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463973:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135990.463976:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.463981:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.463988:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de384e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464003:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464009:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464025:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464030:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.464033:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464039:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464047:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135990.464049:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.464052:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464058:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464106:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c39 expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464120:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de385c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c39 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.464126:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.464128:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789135990.464131:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878400, rc 0) 00000100:00100000:1.0:1789135990.464208:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12662:x1876044644715264:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 752us (965us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789135990.464226:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:0.0:1789135990.467145:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.467251:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644715392 00000100:00100000:2.0:1789135990.467261:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644715392 00000100:00100000:2.0:1789135990.467332:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:2.0:1789135990.467344:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12662:x1876044644715392:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1789135990.467418:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.467436:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 38 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.467445:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.467482:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 38 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.467495:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 38 pid: 14528 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.467525:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666808448:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135990.467636:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f66ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1789135990.470043:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666808448:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135990.470075:0:8299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135990.477739:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135990.482449:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644715648 00000100:00100000:3.0:1789135990.482466:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644715648 00000100:00100000:3.0:1789135990.482548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:3.0:1789135990.482560:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+39:6164:x1876044644715648:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789135990.483092:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+40:6164:x1876044644715648:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 530us (5358us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789135990.483102:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:0.0:1789135990.499358:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.508619:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644715776 00000100:00100000:1.0:1789135990.508635:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644715776 00010000:00010000:1.0:1789135990.509247:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 40 pid: 14528 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135990.509298:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:1.0:1789135990.509311:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+40:2391:x1876044644715776:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135990.509329:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135990.509336:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 40 pid: 14528 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.509349:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 40 pid: 14528 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.509372:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3801 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c1d expref: 40 pid: 14528 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.509389:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.509395:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.509405:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.509413:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.509616:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135990.509689:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+39:2391:x1876044644715776:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 381us (10343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135990.509698:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 108 00010000:00010000:2.0:1789135990.509714:0:8299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509723:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509764:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509771:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509779:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509785:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135990.509788:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509796:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509806:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:2.0:1789135990.509816:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789135990.509820:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.509826:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de386a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.511005:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12662:x1876044644715392:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 43655us (43871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.511017:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:2.0:1789135990.520244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.520294:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644716032 00000100:00100000:1.0:1789135990.520306:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644716032 00000100:00100000:1.0:1789135990.520368:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:1.0:1789135990.520379:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+38:12662:x1876044644716032:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789135990.520675:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+39:12662:x1876044644716032:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 296us (442us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789135990.520684:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:1.0:1789135990.632116:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789135990.632143:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666808576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789135990.632223:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135990.632301:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666808576 00000100:00100000:3.0:1789135990.632309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666808576 00000100:00100000:3.0:1789135990.632376:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789135990.632385:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666808576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789135990.632419:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789135990.632542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666808576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135990.632550:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789135990.635091:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666808576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789135990.754238:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.756052:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644716288 00000100:00100000:1.0:1789135990.756066:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644716288 00000100:00100000:1.0:1789135990.756147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:1.0:1789135990.756159:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+39:12673:x1876044644716288:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:1.0:1789135990.756185:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135990.756207:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de3871 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c40 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756285:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756300:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756312:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756343:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756356:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756465:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3886 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756473:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756479:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3886 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135990.756489:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789135990.756564:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756571:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756578:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756584:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167da00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.756588:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756605:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756618:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135990.756621:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.756626:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756633:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3878 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756646:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756651:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756694:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756699:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167de00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.756702:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756707:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756715:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135990.756717:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.756719:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756733:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de387f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756777:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de3871 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c40 expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756791:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3886 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c40 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.756798:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.756800:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135990.756803:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135990.759091:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+41:12673:x1876044644716288:12345-192.168.201.31@tcp:101:cat.0 Request processed in 2922us (4852us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789135990.759105:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:3.0:1789135990.764441:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.764547:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644716544 00000100:00100000:2.0:1789135990.764557:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644716544 00000100:00100000:2.0:1789135990.764616:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:2.0:1789135990.764626:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+41:12673:x1876044644716544:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:2.0:1789135990.765080:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+42:12673:x1876044644716544:12345-192.168.201.31@tcp:35:cat.0 Request processed in 453us (646us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789135990.765090:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:2.0:1789135990.816472:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135990.816575:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644716800 00000100:00100000:1.0:1789135990.816585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644716800 00000100:00100000:1.0:1789135990.816646:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00100000:1.0:1789135990.816665:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+42:12674:x1876044644716800:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:1.0:1789135990.816722:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789135990.816760:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de3824 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c2b expref: 42 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816784:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3886 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c40 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816818:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de385c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c39 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816830:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3816 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c24 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816839:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.816845:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789135990.816929:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816953:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816963:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816977:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816983:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.816989:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817065:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817073:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817087:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135990.817303:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789135990.817313:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438936458060ns, next at 439936455209ns, rc = 0 00010000:00010000:1.0:1789135990.817358:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817368:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817375:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817383:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817390:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817395:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817422:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789135990.817439:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817446:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817452:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817464:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ce00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.817468:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817476:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817487:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:1.0:1789135990.817490:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789135990.817493:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817500:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817516:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817521:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817527:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817531:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135990.817534:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817539:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817557:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135990.817560:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135990.817563:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817569:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3894 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789135990.817579:0:6515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a5f241df reply state 00000000ac70128d transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817590:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135990.817595:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135990.817597:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789135990.817600:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135990.817685:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+40:12674:x1876044644716800:12345-192.168.201.31@tcp:36:rm.0 Request processed in 1029us (1221us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789135990.817693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 214 00010000:00010000:3.0:1789135990.817845:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135990.817878:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.817892:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167de00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135990.817896:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.817902:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.817912:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:3.0:1789135990.817914:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135990.817917:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.817922:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.817932:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135990.817934:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135990.817936:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135990.888463:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135990.888669:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644717056 00000100:00100000:3.0:1789135990.888679:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644717056 00000100:00100000:3.0:1789135990.888760:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 215 00000100:00100000:3.0:1789135990.888771:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+40:12680:x1876044644717056:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789135990.888797:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135990.888820:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de38b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c47 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.889294:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.889310:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.889323:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.889334:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.889341:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.889346:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789135990.890113:0:14528:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789135990.890265:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890277:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890285:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890330:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890337:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890343:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890349:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789135990.890353:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890360:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890373:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:3.0:1789135990.890377:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789135990.890380:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890386:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de38b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135990.890400:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007f685f32 reply state 00000000c2f23ac4 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890410:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890416:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:3.0:1789135990.890424:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135990.890427:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789135990.890460:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de38b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 43 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.890474:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 42 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.891619:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:3.0:1789135990.891628:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135990.891632:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf400, rc 0) 00000100:00100000:3.0:1789135990.891731:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+43:12680:x1876044644717056:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2958us (3275us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789135990.892040:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 215 00000100:00100000:3.0:1789135990.897338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.897453:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644717184 00000100:00100000:2.0:1789135990.897464:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644717184 00000100:00100000:2.0:1789135990.897614:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1789135990.897624:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644717184:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135990.897643:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135990.897673:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c4e expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135990.897697:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789135990.897736:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1789135990.897754:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135990.897764:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.897785:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.897800:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5000, rc 0) 00000100:00100000:2.0:1789135990.897900:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644717184:12345-192.168.201.31@tcp:101:bash.0 Request processed in 278us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.897907:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00080000:3.0:1789135990.897970:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789135990.901962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135990.902456:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644717312 00000100:00100000:2.0:1789135990.902466:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644717312 00000100:00100000:2.0:1789135990.902530:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:2.0:1789135990.902541:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:12680:x1876044644717312:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135990.902561:0:8536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135990.902579:0:8536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c55 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.902612:0:8536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.902621:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135990.902625:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135990.902630:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 9 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.902688:0:8536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 9 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.902702:0:8536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 9 pid: 8429 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.902716:0:8536:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8536:1876044666808704:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135990.902829:0:8536:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f66eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135990.908407:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135990.908614:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644717440 00000100:00100000:3.0:1789135990.908624:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644717440 00010000:00010000:3.0:1789135990.908680:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 10 pid: 8429 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.908726:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:3.0:1789135990.908736:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2391:x1876044644717440:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135990.908752:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135990.908774:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 10 pid: 8429 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.908807:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 10 pid: 8429 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.908837:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.908842:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135990.908851:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 10 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.908881:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 10 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135990.908933:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 10 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135990.908948:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4490780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1876044666808832:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789135990.909067:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789135990.912641:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4490780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6500:1876044666808832:192.168.201.31@tcp:105: 00010000:00010000:1.0:1789135990.912683:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135990.912749:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4547840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2391:x1876044644717440:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 4013us (4350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135990.912761:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 109 00010000:00010000:2.0:1789135990.914581:0:8536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de38d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c4e expref: 9 pid: 8429 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135990.914605:0:8536:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8536:1876044666808704:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135990.914634:0:8536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135990.914648:0:8536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5200, rc 0) 00000100:00100000:2.0:1789135990.914792:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:12680:x1876044644717312:12345-192.168.201.31@tcp:101:bash.0 Request processed in 12251us (12837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135990.914801:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:0.0:1789135990.919834:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135990.920200:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644717696 00000100:00100000:3.0:1789135990.920211:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644717696 00000100:00100000:3.0:1789135990.920311:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1789135990.920323:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+43:12680:x1876044644717696:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:3.0:1789135990.920640:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12680:x1876044644717696:12345-192.168.201.31@tcp:35:bash.0 Request processed in 320us (817us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789135990.920646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00010000:00010000:0.0:1789135991.016061:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135991.219967:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.220193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644717824 00000100:00100000:1.0:1789135991.220230:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644717824 00000100:00100000:1.0:1789135991.220317:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 216 00000100:00100000:1.0:1789135991.220328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+44:12696:x1876044644717824:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135991.220353:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135991.220377:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de38e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c5c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789135991.220723:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789135991.220793:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.220808:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.220821:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135991.220899:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789135991.220904:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789135991.220924:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.220949:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de38e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c5c expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.220967:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c5c expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.220976:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135991.220979:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789135991.220982:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ce00, rc 0) 00000100:00100000:1.0:1789135991.221058:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+45:12696:x1876044644717824:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 732us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135991.221065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 216 00000100:00100000:0.0:1789135991.229958:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.230126:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718080 00000100:00100000:1.0:1789135991.230137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718080 00000100:00100000:1.0:1789135991.230202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 217 00000100:00100000:1.0:1789135991.230213:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+45:12696:x1876044644718080:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135991.230236:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135991.230270:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de38ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c63 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.230383:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.230398:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.230410:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135991.230422:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789135991.230685:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de38ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c63 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.230705:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c63 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.230714:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:1.0:1789135991.230717:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135991.230735:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167de00, rc 0) 00000100:00100000:1.0:1789135991.230801:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+47:12696:x1876044644718080:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 590us (857us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789135991.230809:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 217 00000100:00100000:0.0:1789135991.238223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.238379:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718336 00000100:00100000:2.0:1789135991.238389:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718336 00000100:00100000:2.0:1789135991.238471:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 218 00000100:00100000:2.0:1789135991.238482:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+47:12696:x1876044644718336:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135991.238535:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135991.238558:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de3904 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c6a expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.238672:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de390b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.238687:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de390b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.238699:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de390b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135991.238711:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135991.238823:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de3904 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c6a expref: 50 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.238841:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de390b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c6a expref: 49 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.238849:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:2.0:1789135991.238852:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135991.239168:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5600, rc 0) 00000100:00100000:2.0:1789135991.239430:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+49:12696:x1876044644718336:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 947us (1214us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789135991.239438:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 218 00000100:00100000:0.0:1789135991.250495:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135991.258272:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718464 00000100:00100000:3.0:1789135991.258287:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718464 00000100:00100000:3.0:1789135991.258361:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1789135991.258373:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+49:2392:x1876044644718464:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135991.258389:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135991.258414:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de38f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c63 expref: 49 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.258436:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:3.0:1789135991.258441:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135991.258496:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+48:2392:x1876044644718464:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 126us (8012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.258504:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:0.0:1789135991.272156:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.273066:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718592 00000100:00100000:2.0:1789135991.273078:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718592 00000100:00100000:2.0:1789135991.273145:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:2.0:1789135991.273169:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2390:x1876044644718592:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:2.0:1789135991.273507:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.273541:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.273551:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135991.273557:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135991.273562:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.273607:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 8 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.273624:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 8 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.273640:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1876044666808960:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135991.273770:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f66ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1789135991.279285:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135991.279654:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718720 00000100:00100000:0.0:1789135991.279664:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718720 00002000:00100000:0.0:1789135991.279716:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90a6c4544780 x1876044644718720/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:422/0 lens 504/0 e 0 to 0 dl 1789136002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135991.279728:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c4544780 with x1876044644718720 ext(0->8) 00010000:00010000:0.0:1789135991.279738:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 9 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.279754:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 9 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135991.279762:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a6c4544780 00000100:00100000:0.0:1789135991.279798:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:0.0:1789135991.279809:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2391:x1876044644718720:12345-192.168.201.31@tcp:4:lfs.0 00000100:00100000:2.0:1789135991.280778:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e70c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8429:1876044666808960:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135991.280820:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135991.286474:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2391:x1876044644718720:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 6655us (7189us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789135991.286489:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00002000:00100000:0.0:1789135991.286503:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90a6c4544780 x1876044644718720/t4294967309(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:422/0 lens 504/448 e 0 to 0 dl 1789136002 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789135991.286532:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c4544780 with x1876044644718720 ext(0->8) 00010000:00010000:0.0:1789135991.286543:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 11 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.286563:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 11 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789135991.286570:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90a6c4544780 00000100:00100000:2.0:1789135991.287125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.287210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.287257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.287276:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.287296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.287317:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644719104 00000100:00100000:2.0:1789135991.287325:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644719104 00000100:00100000:2.0:1789135991.287365:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 150 00000100:00100000:2.0:1789135991.287373:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2389:x1876044644719104:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135991.287437:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2389:x1876044644719104:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.287445:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 150 00000100:00100000:2.0:1789135991.287473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718976 00000100:00100000:2.0:1789135991.287476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718976 00000100:00100000:2.0:1789135991.287509:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644719232 00000100:00100000:2.0:1789135991.287512:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644719232 00000001:00080000:0.0:1789135991.287696:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789135991.287708:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1789135991.288007:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644718848 00000100:00100000:3.0:1789135991.288012:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644718848 00000100:00100000:3.0:1789135991.288057:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 467 00000100:00100000:3.0:1789135991.288065:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644718848:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135991.288099:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644718848:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 34us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.288107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 467 00000100:00080000:3.0:1789135991.288138:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789135991.288143:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135991.288242:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644719360 00000100:00100000:3.0:1789135991.288247:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644719360 00000100:00100000:3.0:1789135991.288291:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 408 00000100:00100000:3.0:1789135991.288298:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644718976:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135991.288331:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644718976:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.288347:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 408 00000100:00100000:3.0:1789135991.288363:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 409 00000100:00100000:3.0:1789135991.288370:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644719360:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135991.288397:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644719360:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.288403:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 409 00000100:00100000:2.0:1789135991.288627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 410 00000100:00100000:2.0:1789135991.288634:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644719232:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789135991.288678:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644719232:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 44us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.288685:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 410 00000100:00080000:0.0:1789135991.294696:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789135991.299670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.300190:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644719488 00000100:00100000:1.0:1789135991.300201:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644719488 00010000:00010000:1.0:1789135991.300256:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 7 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135991.300305:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:1.0:1789135991.300316:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644719488:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135991.300333:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789135991.300351:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789135991.300354:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789135990 00002000:00010000:1.0:1789135991.300357:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789135990 00002000:00010000:1.0:1789135991.300359:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789135990 00002000:00010000:1.0:1789135991.300360:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789135991.300366:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 7 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300379:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 7 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300402:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092362b14/0x559c8745c6de38da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c55 expref: 7 pid: 8536 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300441:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135991.300446:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135991.300451:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300461:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.300494:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135991.300696:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+6:2390:x1876044644719488:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 380us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135991.300705:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00010000:00010000:3.0:1789135991.302075:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302090:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302113:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302119:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302124:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302128:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135991.302131:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302154:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302168:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.302173:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009f4f6e8/0x559c8745c6de3919 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135991.302263:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644718592:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 29093us (30114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.302272:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:3.0:1789135991.319706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.319964:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644719744 00000100:00100000:2.0:1789135991.319991:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644719744 00000100:00100000:2.0:1789135991.320055:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:2.0:1789135991.320065:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+48:12696:x1876044644719744:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:2.0:1789135991.320132:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de390b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c6a expref: 48 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135991.320335:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789135991.320385:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789135991.321159:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1789135991.321200:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.321218:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 52 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.321229:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.321266:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 52 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.321281:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 52 pid: 14528 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.321293:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1876044666809088:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135991.321405:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f66ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1789135991.344291:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1876044666809088:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135991.344332:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135991.346345:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.352954:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644719872 00000100:00100000:1.0:1789135991.352969:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644719872 00010000:00010000:1.0:1789135991.353101:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 53 pid: 14528 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135991.353156:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 111 00000100:00100000:1.0:1789135991.353167:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+53:2392:x1876044644719872:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135991.353182:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135991.353189:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 53 pid: 14528 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.353202:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 53 pid: 14528 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.355962:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de38c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c47 expref: 53 pid: 14528 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.355986:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:1.0:1789135991.355992:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.356001:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.356020:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.356063:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135991.356136:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+52:2392:x1876044644719872:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 2969us (10130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135991.356146:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 111 00010000:00010000:2.0:1789135991.356716:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.356726:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789135991.357044:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789135991.357178:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789135991.357272:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666809216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135991.357331:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135991.357372:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789135991.357527:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666809216 00000100:00100000:3.0:1789135991.357536:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666809216 00000100:00100000:3.0:1789135991.357604:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789135991.357614:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876044666809216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1789135991.357688:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789135991.357730:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876044666809216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.357738:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789135991.358185:0:6518:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1789135991.358192:0:6518:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1789135991.358220:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7f662a1c0, transno 4294967308 00000100:00100000:2.0:1789135991.358246:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666809216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789135991.358377:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789135991.358434:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666809344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789135991.358468:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789135991.358496:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f66ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135991.358777:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666809344 00000100:00100000:0.0:1789135991.358783:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666809344 00000100:00100000:0.0:1789135991.359077:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789135991.359088:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6518:x1876044666809344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789135991.359225:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6518:x1876044666809344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 139us (755us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789135991.360552:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1876044666809344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789135991.360629:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789135991.360695:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.360705:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.360712:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.360718:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135991.360722:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.360729:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.360761:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:2.0:1789135991.360764:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789135991.360768:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.360774:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3920 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789135991.360921:0:6518:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789135991.360998:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789135991.361010:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439480154946ns, next at 440480152646ns, rc = 0 00000001:00080000:2.0:1789135991.361016:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789135991.361041:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa7d3700) 00010000:00010000:2.0:1789135991.361044:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789135991.361051:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de390b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c6a expref: 56 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.361166:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+55:12696:x1876044644719744:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 41101us (41478us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789135991.361176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000020:00080000:2.0:1789135991.361182:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789135991.361472:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789135991.367334:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.379923:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644720000 00000100:00100000:1.0:1789135991.379941:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644720000 00000100:00100000:0.0:1789135991.380482:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 219 00000100:00100000:0.0:1789135991.380495:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+55:12696:x1876044644720000:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135991.380519:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135991.380543:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ee00/0x559c8745c6de3927 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c71 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.380602:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ee00/0x559c8745c6de3927 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c71 expref: 56 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.380634:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ee00/0x559c8745c6de3927 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c71 expref: 56 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.380665:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135991.380669:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135991.380673:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3ee00, rc 0) 00000100:00100000:0.0:1789135991.380758:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+56:12696:x1876044644720000:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 266us (13434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135991.380766:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 219 00000100:00100000:1.0:1789135991.389668:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135991.389769:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644720256 00000100:00100000:3.0:1789135991.389780:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644720256 00000100:00100000:3.0:1789135991.389894:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:3.0:1789135991.389919:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+56:12696:x1876044644720256:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1789135991.390714:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4547840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+57:12696:x1876044644720256:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 793us (1063us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789135991.390723:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1789135991.525182:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.525292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644720384 00000100:00100000:2.0:1789135991.525300:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644720384 00000100:00100000:2.0:1789135991.525348:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 220 00000100:00100000:2.0:1789135991.525358:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+57:12706:x1876044644720384:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1789135991.525559:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525574:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525584:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525592:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525596:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525600:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525704:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525712:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525719:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789135991.525768:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525780:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525794:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525800:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.525806:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135991.526085:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526094:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526104:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135991.526106:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135991.526109:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526113:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de392e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526123:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526127:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526131:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526134:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135991.526140:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526145:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526149:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:2.0:1789135991.526151:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135991.526152:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526156:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de3935 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526162:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526165:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526169:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526172:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135991.526173:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526176:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526179:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135991.526181:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135991.526185:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.526189:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de393c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.526270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+57:12706:x1876044644720384:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 912us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.526277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 220 00000100:00100000:3.0:1789135991.592772:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.593052:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644720640 00000100:00100000:1.0:1789135991.593062:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644720640 00000100:00100000:1.0:1789135991.593130:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:1.0:1789135991.593140:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+57:12709:x1876044644720640:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135991.593162:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135991.593185:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3943 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c78 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593282:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593299:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593311:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593325:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593334:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593341:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593451:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3958 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593459:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593466:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3958 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135991.593477:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789135991.593552:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593559:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593574:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593580:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167de00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135991.593585:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593593:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593605:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:1.0:1789135991.593607:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135991.593613:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593619:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de394a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593632:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593638:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593657:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593662:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135991.593665:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593682:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593701:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:1.0:1789135991.593703:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135991.593706:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593712:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3951 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593748:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de3943 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c78 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593761:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3958 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c78 expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.593768:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:1.0:1789135991.593770:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789135991.593772:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879200, rc 0) 00000100:00100000:1.0:1789135991.594053:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+59:12709:x1876044644720640:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 912us (1288us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789135991.594062:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:1.0:1789135991.603010:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135991.603098:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644720768 00000100:00100000:0.0:1789135991.603107:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644720768 00000100:00100000:0.0:1789135991.603164:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 222 00000100:00100000:0.0:1789135991.603171:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+59:12709:x1876044644720768:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:0.0:1789135991.603231:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603248:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603257:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603288:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603292:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603311:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603315:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135991.603319:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603323:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603333:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135991.603335:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135991.603338:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.603342:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135991.603413:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+59:12709:x1876044644720768:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 241us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135991.603419:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 222 00000100:00100000:2.0:1789135991.611167:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135991.611227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644721024 00000100:00100000:3.0:1789135991.611237:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644721024 00000100:00100000:3.0:1789135991.611296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1789135991.611306:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+59:12709:x1876044644721024:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1789135991.611542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+60:12709:x1876044644721024:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 236us (393us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789135991.611550:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1789135991.762321:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.762435:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644721280 00000100:00100000:2.0:1789135991.762455:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644721280 00000100:00100000:2.0:1789135991.762522:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:2.0:1789135991.762532:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+60:12719:x1876044644721280:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135991.762556:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135991.762559:0:8299:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789135991.762588:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ce00/0x559c8745c6de38e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c5c expref: 60 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.762608:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135991.762614:0:8299:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789135991.762628:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de396d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c7f expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.762759:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.762774:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.762802:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135991.762815:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789135991.763282:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de396d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c7f expref: 62 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.763299:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c7f expref: 61 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.763308:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135991.763311:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135991.763313:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5600, rc 0) 00000100:00100000:2.0:1789135991.763417:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+61:12719:x1876044644721280:12345-192.168.201.31@tcp:101:bash.0 Request processed in 885us (1106us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789135991.763425:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:1.0:1789135991.776931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.777081:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644721408 00000100:00100000:2.0:1789135991.777093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644721408 00000100:00100000:2.0:1789135991.777162:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 224 00000100:00100000:2.0:1789135991.777175:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+61:12719:x1876044644721408:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789135991.777203:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135991.777228:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3982 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c86 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.777269:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.777304:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.777317:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.777442:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de3982 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.777459:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.777468:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135991.777471:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789135991.777475:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5200, rc 0) 00000100:00100000:2.0:1789135991.777541:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4546580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+62:12719:x1876044644721408:12345-192.168.201.31@tcp:101:bash.0 Request processed in 369us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.777549:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 224 00000100:00100000:1.0:1789135991.781128:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135991.781901:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644721536 00000100:00100000:3.0:1789135991.781912:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644721536 00000100:00100000:3.0:1789135991.781986:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789135991.781997:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4547c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+62:2389:x1876044644721536:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135991.782013:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135991.782041:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c7f expref: 62 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.782061:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:3.0:1789135991.782066:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135991.782129:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4547c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+61:2389:x1876044644721536:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 135us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.782137:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789135991.784405:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.789277:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644721792 00000100:00100000:1.0:1789135991.789291:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644721792 00000100:00100000:0.0:1789135991.789456:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 225 00000100:00100000:0.0:1789135991.789468:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+61:12719:x1876044644721792:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:0.0:1789135991.789526:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135991.789556:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3958 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c78 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.789575:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135991.789587:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135991.789795:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.789810:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.789820:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135991.789881:0:14528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789135991.789904:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008d2b123e reply state 00000000073d6886 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.789917:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.789923:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135991.789926:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789135991.789928:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789135991.790033:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4492580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+63:12719:x1876044644721792:12345-192.168.201.31@tcp:36:bash.0 Request processed in 567us (5636us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789135991.790042:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 225 00000020:00080000:0.0:1789135991.790047:0:14528:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789135991.794391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135991.794717:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644721920 00000100:00100000:0.0:1789135991.794727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644721920 00000100:00100000:0.0:1789135991.794882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 226 00000100:00100000:0.0:1789135991.794893:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+63:12719:x1876044644721920:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789135991.794917:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135991.794938:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c8d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.795045:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.795062:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.795073:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135991.795103:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789135991.795108:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135991.795129:0:6517:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.795157:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3997 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.795174:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.795183:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135991.795186:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135991.795189:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f600, rc 0) 00000100:00100000:0.0:1789135991.795248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4544f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+64:12719:x1876044644721920:12345-192.168.201.31@tcp:101:bash.0 Request processed in 357us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135991.795255:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 226 00000100:00100000:1.0:1789135991.804060:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135991.804150:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644722176 00000100:00100000:3.0:1789135991.804160:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644722176 00000100:00100000:3.0:1789135991.804235:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:3.0:1789135991.804245:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+64:12719:x1876044644722176:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:3.0:1789135991.804610:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+65:12719:x1876044644722176:12345-192.168.201.31@tcp:35:bash.0 Request processed in 365us (558us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789135991.804618:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:3.0:1789135991.922128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.922242:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644722304 00000100:00100000:2.0:1789135991.922251:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644722304 00000100:00100000:2.0:1789135991.922316:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 227 00000100:00100000:2.0:1789135991.922326:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+65:12725:x1876044644722304:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135991.922351:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135991.922373:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c94 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.922452:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de39ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.922477:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de39ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.922493:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de39ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135991.922536:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789135991.922540:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135991.922561:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de39ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.922740:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c94 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.922760:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de39ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c94 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.922769:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135991.922772:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789135991.922776:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5400, rc 0) 00000100:00100000:2.0:1789135991.922839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+66:12725:x1876044644722304:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 514us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.922846:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 227 00000100:00100000:1.0:1789135991.928924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135991.929012:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644722432 00000100:00100000:0.0:1789135991.929022:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644722432 00000100:00100000:0.0:1789135991.929102:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 228 00000100:00100000:0.0:1789135991.929112:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+66:12725:x1876044644722432:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789135991.929133:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135991.929156:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de39b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08c9b expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929208:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929219:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929228:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929235:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929239:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929243:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929307:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929313:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929317:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135991.929360:0:14528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789135991.929364:0:14528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135991.929383:0:14528:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929395:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929405:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929411:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929417:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929432:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135991.929442:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929447:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929456:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135991.929458:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135991.929462:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929466:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de39ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929484:0:14528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929487:0:14528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929491:0:14528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929494:0:14528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135991.929495:0:14528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929499:0:14528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929503:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:0.0:1789135991.929504:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135991.929506:0:14528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929509:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de39c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929526:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de39b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929533:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 67 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135991.929546:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135991.929547:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135991.929549:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e000, rc 0) 00000100:00100000:0.0:1789135991.930756:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4546d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12725:x1876044644722432:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1639us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135991.930766:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 228 00000100:00100000:1.0:1789135991.937124:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.937233:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644722688 00000100:00100000:2.0:1789135991.937243:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644722688 00000100:00100000:2.0:1789135991.937309:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 229 00000100:00100000:2.0:1789135991.937319:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12725:x1876044644722688:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135991.937339:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135991.937373:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ca2 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937492:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937508:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937515:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937523:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937555:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937568:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.937593:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666809472:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135991.937939:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.937949:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.937959:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666809600:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135991.937994:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789135991.941808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:2.0:1789135991.942463:0:8299:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.31@tcp) returned -22 from blocking AST (req@00000000730541dc x1876044666809472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.942484:0:8299:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.942508:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e000/0x559c8745c6de39c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c9b expref: 68 pid: 14528 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135991.942524:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666809472:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135991.942539:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666809600:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135991.942570:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135991.942575:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.942655:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.942665:0:8299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135991.943817:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644722816 00000100:00100000:1.0:1789135991.943827:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644722816 00000100:00100000:1.0:1789135991.944305:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789135991.944317:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:2391:x1876044644722816:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135991.944335:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135991.944338:0:6502:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 559c8745c6de39c8) 00010000:00010000:1.0:1789135991.944340:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135991.944412:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:2391:x1876044644722816:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 98us (2614us total) trans 0 rc 116/116 00000100:00100000:1.0:1789135991.944420:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789135991.946114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135991.946207:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644722944 00000100:00100000:3.0:1789135991.946215:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644722944 00010000:00010000:3.0:1789135991.946255:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135991.946345:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:3.0:1789135991.946356:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+68:2391:x1876044644722944:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135991.946370:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135991.946376:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.946389:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.946411:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f600/0x559c8745c6de399e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c8d expref: 68 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.946436:0:13680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:3.0:1789135991.946442:0:13680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.946473:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.946482:0:13680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135991.946515:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135991.946572:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+67:2391:x1876044644722944:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 218us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135991.946725:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 112 00010000:00010000:2.0:1789135991.946961:0:8299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.946971:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135991.947000:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789135991.947146:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 68 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.947162:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 67 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.947169:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135991.947172:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789135991.947174:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5a00, rc 0) 00000100:00100000:2.0:1789135991.947208:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12725:x1876044644722688:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 9891us (10094us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789135991.947215:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 229 00000100:00100000:1.0:1789135991.952734:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.953221:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644723200 00000100:00100000:2.0:1789135991.953231:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644723200 00000100:00100000:2.0:1789135991.953329:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:2.0:1789135991.953340:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12725:x1876044644723200:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:2.0:1789135991.953356:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135991.953382:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ee00/0x559c8745c6de3927 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c71 expref: 67 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.953403:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135991.953418:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135991.953520:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+66:12725:x1876044644723200:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 182us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.953528:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1789135991.956686:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135991.956781:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644723328 00000100:00100000:2.0:1789135991.956790:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644723328 00000100:00100000:2.0:1789135991.957028:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 230 00000100:00100000:2.0:1789135991.957038:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+66:12725:x1876044644723328:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:2.0:1789135991.957148:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.957166:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135991.957178:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789135991.957273:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789135991.957359:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+66:12725:x1876044644723328:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 322us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135991.957367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 230 00000100:00100000:3.0:1789135991.959991:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135991.961358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644723456 00000100:00100000:1.0:1789135991.961370:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644723456 00000100:00100000:1.0:1789135991.961446:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:1.0:1789135991.961456:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+66:12725:x1876044644723456:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789135991.961477:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135991.961497:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ca9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.961552:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.961594:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.961614:0:6516:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.961627:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.961650:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:1.0:1789135991.961653:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789135991.961657:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135991.961665:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878400, rc 0) 00000100:00100000:1.0:1789135991.961719:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12725:x1876044644723456:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 264us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135991.961727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 231 00010000:00010000:0.0:1789135992.040267:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135992.296156:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135992.296163:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135992.296181:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789135992.296188:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135992.296296:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4493480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666809728:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135992.296466:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07600 going to sleep for 11 seconds 00000100:00100000:1.0:1789135992.308362:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.308521:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644723584 00000100:00100000:0.0:1789135992.308531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644723584 00000100:00100000:0.0:1789135992.308596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:0.0:1789135992.308607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644723584:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135992.308654:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135992.308777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644723584:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 171us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.308786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:0.0:1789135992.310671:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4493480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666809728:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789135992.316935:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.318219:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644723712 00000100:00100000:2.0:1789135992.318234:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644723712 00000100:00100000:2.0:1789135992.318340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:2.0:1789135992.318352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12726:x1876044644723712:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789135992.318458:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318479:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318492:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318529:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318537:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318544:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318573:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318582:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318588:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135992.318646:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789135992.318651:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135992.318667:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318677:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318683:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318689:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318704:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135992.318709:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318717:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318730:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:2.0:1789135992.318733:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.318738:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318744:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de39f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318755:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318761:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318767:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318772:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135992.318775:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318782:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318801:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff90a7fa7c3e00) 00010000:00010000:2.0:1789135992.318804:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.318807:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318813:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de39f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318831:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318837:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318843:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318848:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135992.318851:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318879:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318887:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135992.318889:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.318892:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.318899:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de3a00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.319486:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12726:x1876044644723712:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 1133us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.319495:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:3.0:1789135992.325032:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135992.325181:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644723968 00000100:00100000:1.0:1789135992.325191:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644723968 00000100:00100000:1.0:1789135992.325260:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 234 00000100:00100000:1.0:1789135992.325271:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+67:12726:x1876044644723968:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789135992.325293:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789135992.325316:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3a07 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cb0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325458:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325473:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325485:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789135992.325497:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789135992.325582:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325590:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325597:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325604:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135992.325608:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325617:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325638:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:1.0:1789135992.325642:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789135992.325647:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325662:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325707:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3a07 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cb0 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325718:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:1.0:1789135992.325721:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789135992.325725:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879400/0x559c8745c6de3a07 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cb0 expref: 69 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.325735:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:1.0:1789135992.325811:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644723968:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 541us (788us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789135992.325819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 234 00000100:00100000:1.0:1789135992.336340:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.336446:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644724096 00000100:00100000:0.0:1789135992.336459:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644724096 00000100:00100000:0.0:1789135992.336529:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 235 00000100:00100000:0.0:1789135992.336539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644724096:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789135992.336580:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789135992.336704:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644724096:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 165us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.336712:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 235 00000100:00100000:3.0:1789135992.351699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.351897:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644724352 00000100:00100000:0.0:1789135992.351909:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644724352 00000100:00100000:0.0:1789135992.351979:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 236 00000100:00100000:0.0:1789135992.352154:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644724352:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.352178:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135992.352182:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789135992.352220:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5400/0x559c8745c6de39ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c94 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.352243:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135992.352250:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135992.352268:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a1c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cb7 expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789135992.352831:0:14528:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789135992.353271:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3a23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.353287:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.353299:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3a23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.353351:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a1c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cb7 expref: 70 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.353368:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3a23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cb7 expref: 69 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.353396:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1000) 00010000:00010000:0.0:1789135992.353399:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789135992.353411:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e400, rc 0) 00000100:00100000:0.0:1789135992.353477:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4490780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+69:12726:x1876044644724352:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1488us (1790us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789135992.353483:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 236 00000100:00100000:3.0:1789135992.359831:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.359997:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644724608 00000100:00100000:0.0:1789135992.360008:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644724608 00000100:00100000:0.0:1789135992.360071:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 237 00000100:00100000:0.0:1789135992.360082:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+69:12726:x1876044644724608:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.360146:0:14529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135992.360174:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e400/0x559c8745c6de3a23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cb7 expref: 69 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360194:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1000) 00010000:00010000:0.0:1789135992.360208:0:14529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789135992.360230:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360244:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360254:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360266:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360288:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360295:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360340:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360347:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360354:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360360:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.360364:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360371:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360380:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:0.0:1789135992.360383:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.360387:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360393:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3a31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360402:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360422:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360426:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360429:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.360431:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360434:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360439:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5b5bab03 (ffff90a7fa5a1600) 00010000:00010000:0.0:1789135992.360441:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.360442:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.360446:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a38 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5b5bab03 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.360514:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644724608:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 434us (694us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789135992.360519:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 237 00000100:00100000:1.0:1789135992.362903:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.363251:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644724736 00000100:00100000:0.0:1789135992.363260:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644724736 00000100:00100000:0.0:1789135992.363305:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 238 00000100:00100000:0.0:1789135992.363311:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+68:12726:x1876044644724736:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.363328:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135992.363360:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fc00/0x559c8745c6de3a3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cbe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.363395:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.363415:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.363428:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.363514:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fc00/0x559c8745c6de3a3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 70 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.363528:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.363534:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135992.363536:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789135992.363538:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e600, rc 0) 00000100:00100000:0.0:1789135992.363589:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+69:12726:x1876044644724736:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 277us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.363596:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 238 00000100:00100000:3.0:1789135992.366441:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135992.370115:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644724992 00000100:00100000:1.0:1789135992.370135:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644724992 00000100:00100000:1.0:1789135992.370249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 239 00000100:00100000:1.0:1789135992.370261:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+69:12726:x1876044644724992:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789135992.370345:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.370362:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.370395:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789135992.370565:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789135992.370576:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440489720602ns, next at 441489717687ns, rc = 0 00000004:00010000:1.0:1789135992.370809:0:6515:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000024bcb8f5 reply state 0000000042f218d4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.370823:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.370831:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135992.370833:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789135992.370838:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789135992.371009:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+71:12726:x1876044644724992:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 747us (4571us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789135992.371017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 239 00000100:00100000:3.0:1789135992.373962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.375921:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644725120 00000100:00100000:0.0:1789135992.375937:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644725120 00000100:00100000:0.0:1789135992.376026:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 240 00000100:00100000:0.0:1789135992.376037:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+71:12726:x1876044644725120:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.376061:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135992.376098:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cc5 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.376158:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 72 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.376174:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 72 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.376194:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135992.376197:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135992.376201:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fe00, rc 0) 00000100:00100000:0.0:1789135992.376274:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+72:12726:x1876044644725120:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 240us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.376282:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 240 00000100:00100000:2.0:1789135992.380037:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.380180:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644725248 00000100:00100000:0.0:1789135992.380190:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644725248 00000100:00100000:0.0:1789135992.380258:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:0.0:1789135992.380269:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2392:x1876044644725248:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789135992.380474:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2392:x1876044644725248:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 208us (448us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789135992.380480:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00080000:3.0:1789135992.380607:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135992.387234:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.387591:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644725504 00000100:00100000:2.0:1789135992.387602:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644725504 00000100:00100000:2.0:1789135992.387677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:2.0:1789135992.387688:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+72:12726:x1876044644725504:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135992.387960:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+73:12726:x1876044644725504:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 273us (735us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789135992.387968:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:3.0:1789135992.391047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.391158:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644725760 00000100:00100000:0.0:1789135992.391169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644725760 00000100:00100000:0.0:1789135992.391244:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 241 00000100:00100000:0.0:1789135992.391257:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+73:12726:x1876044644725760:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789135992.391370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+73:12726:x1876044644725760:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 116us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.391397:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 241 00000100:00100000:1.0:1789135992.398836:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.399649:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644725888 00000100:00100000:0.0:1789135992.399660:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644725888 00000100:00100000:0.0:1789135992.399727:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 242 00000100:00100000:0.0:1789135992.399738:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+73:12726:x1876044644725888:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.399759:0:14528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135992.399780:0:14528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fc00/0x559c8745c6de3a5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ccc expref: -99 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.399886:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.399902:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.399915:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789135992.399960:0:14528:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789135992.399980:0:14528:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.400252:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fc00/0x559c8745c6de3a5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ccc expref: 75 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.400271:0:14528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ccc expref: 74 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.400279:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135992.400296:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789135992.400300:0:14528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f400, rc 0) 00000100:00100000:0.0:1789135992.400372:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+74:12726:x1876044644725888:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 636us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.400380:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 242 00000100:00100000:3.0:1789135992.404943:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.405248:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726016 00000100:00100000:2.0:1789135992.405257:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726016 00000100:00100000:2.0:1789135992.405316:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:2.0:1789135992.405327:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+10:2391:x1876044644726016:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789135992.405346:0:8536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135992.405369:0:8536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cd3 expref: -99 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789135992.405395:0:8536:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40c77, blocks: 0x0 00010000:00010000:2.0:1789135992.405538:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1789135992.405545:0:8536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135992.405554:0:8536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 11 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.405592:0:8536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 11 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.405606:0:8536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4a00, rc 0) 00000100:00100000:2.0:1789135992.406395:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2391:x1876044644726016:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1065us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.406416:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:1.0:1789135992.410205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.410294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726272 00000100:00100000:2.0:1789135992.410304:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726272 00000100:00100000:2.0:1789135992.410394:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 243 00000100:00100000:2.0:1789135992.410478:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+74:12726:x1876044644726272:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789135992.410639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c451a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+74:12726:x1876044644726272:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 165us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.410646:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 243 00000100:00100000:3.0:1789135992.413673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.413742:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726400 00000100:00100000:0.0:1789135992.413752:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726400 00000100:00100000:0.0:1789135992.413815:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:0.0:1789135992.413825:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+11:12726:x1876044644726400:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.413842:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789135992.413893:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cda expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.413930:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 12 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.413940:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135992.413944:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789135992.413950:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.413985:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 12 pid: 8536 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.413998:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 12 pid: 8536 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.414033:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666809856:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135992.414334:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135992.417607:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135992.417670:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726528 00000100:00100000:3.0:1789135992.417679:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726528 00010000:00010000:3.0:1789135992.417720:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 13 pid: 8536 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.417757:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:3.0:1789135992.417767:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+13:2391:x1876044644726528:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135992.417783:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.417806:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 13 pid: 8536 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.417820:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 13 pid: 8536 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.417848:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135992.417887:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135992.417898:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.417908:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.417948:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 13 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.417963:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1876044666809984:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789135992.418055:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07300 going to sleep for 11 seconds 00010000:00010000:1.0:1789135992.418658:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008107a8d0/0x559c8745c6de3a69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cd3 expref: 13 pid: 8536 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.418675:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d52c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666809856:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135992.418698:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.418709:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fc00, rc 0) 00000100:00100000:1.0:1789135992.418761:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+12:12726:x1876044644726400:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 4938us (5098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135992.418769:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:1.0:1789135992.425579:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1876044666809984:192.168.201.31@tcp:105: 00010000:00010000:1.0:1789135992.425610:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135992.425682:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2391:x1876044644726528:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 7914us (8086us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135992.425694:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:3.0:1789135992.429838:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.430578:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726656 00000100:00100000:2.0:1789135992.430589:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726656 00002000:00100000:2.0:1789135992.430701:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff90a7f671e580 x1876044644726656/t0(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:423/0 lens 504/0 e 0 to 0 dl 1789136003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135992.430713:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7f671e580 with x1876044644726656 ext(0->12) 00002000:00010000:2.0:1789135992.430721:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a7f671e580 00000100:00100000:2.0:1789135992.430795:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:2.0:1789135992.430806:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+11:2392:x1876044644726656:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789135992.431997:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+13:2392:x1876044644726656:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 1188us (2164us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789135992.432018:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00002000:00100000:2.0:1789135992.432028:0:8437:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff90a7f671e580 x1876044644726656/t4294967321(0) o4->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:423/0 lens 504/448 e 0 to 0 dl 1789136003 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789135992.432038:0:8437:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a7f671e580 with x1876044644726656 ext(0->12) 00002000:00010000:2.0:1789135992.432043:0:8437:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a7f671e580 00000100:00100000:0.0:1789135992.435681:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135992.435988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726784 00000100:00100000:3.0:1789135992.436000:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726784 00000100:00100000:3.0:1789135992.436061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 244 00000100:00100000:3.0:1789135992.436071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+74:12726:x1876044644726784:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789135992.440186:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1789135992.440209:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789135992.440303:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789135992.440327:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7c12ed540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789135992.440332:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7ceab6d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7c12ed780 00000020:00080000:2.0:1789135992.440336:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7ceab6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c44cc600 00000004:00080000:2.0:1789135992.440364:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1789135992.440511:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789135992.440535:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666810112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789135992.440639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135992.440689:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666810112 00000100:00100000:3.0:1789135992.440696:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666810112 00000100:00100000:3.0:1789135992.440749:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789135992.440759:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666810112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789135992.440792:0:8429:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1789135992.440828:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa40c76, atime: 0x6aa40c76, ctime: 0x6aa40c76, blocks: 0x8 00010000:00010000:3.0:1789135992.440838:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.440873:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789135992.440878:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135992.440885:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.440902:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.440912:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.440935:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.440953:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789135992.441105:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1876044666810112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 347us (477us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789135992.441112:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1789135992.441134:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135992.441140:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.441147:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135992.441152:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.441162:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.441181:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.441189:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3a77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.441210:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135992.441218:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135992.441220:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789135992.441258:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7f671f0c0/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789135992.441265:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666810112:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789135992.441346:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441355:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441361:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441366:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.441371:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441377:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441390:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90a7fa5a1d00) 00010000:00010000:0.0:1789135992.441393:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.441397:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441403:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf000/0x559c8745c6de3775 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441428:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441444:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441449:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441454:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.441458:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441464:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441473:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90a7fa7d3600) 00010000:00010000:0.0:1789135992.441476:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.441479:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441484:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de381d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441502:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441509:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441514:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441520:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.441528:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441535:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441544:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:0.0:1789135992.441547:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.441550:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441556:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878c00/0x559c8745c6de389b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441580:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441587:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441592:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441598:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.441600:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441606:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441614:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a6c2b0f000) 00010000:00010000:0.0:1789135992.441616:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.441636:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441645:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafc00/0x559c8745c6de38be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441664:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441670:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441675:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441681:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.441683:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441689:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441697:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135992.441700:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.441703:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441708:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fa00/0x559c8745c6de3990 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441719:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441734:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441739:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441744:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.441747:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441753:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441761:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135992.441763:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789135992.441767:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.441773:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879200/0x559c8745c6de3a4d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789135992.442089:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789135992.443327:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666810240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789135992.443409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135992.443482:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666810368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789135992.443503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789135992.443533:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666810240 00000100:00100000:1.0:1789135992.443538:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666810240 00000100:00100000:1.0:1789135992.443578:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666810368 00000100:00100000:1.0:1789135992.443582:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666810368 00000100:00100000:1.0:1789135992.443602:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789135992.443636:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1876044666810240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789135992.443661:0:8430:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1789135992.443684:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.443701:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 12 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.443707:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789135992.443711:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789135992.443714:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.443747:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 12 pid: 8536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.443760:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 12 pid: 8536 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.443773:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666810496:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789135992.443834:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450300 going to sleep for 11 seconds 00000100:00100000:0.0:1789135992.443933:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789135992.443943:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666810368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789135992.444041:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789135992.444045:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789135992 00002000:00010000:0.0:1789135992.444048:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789135992.444050:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789135991 -> 1789135992 00002000:00010000:0.0:1789135992.444052:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789135992.444102:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3638:x1876044666810368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (596us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789135992.444110:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1789135992.444366:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7c86df840/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789135992.444373:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666810368:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789135992.444511:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7c381e300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789135992.444514:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7d63efa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7c381ea80 00000020:00080000:2.0:1789135992.444517:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7d63ef400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c3f53e00 00000100:00100000:2.0:1789135992.444637:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12726:x1876044644726784:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 8557us (8955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.444646:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 244 00000020:00080000:0.0:1789135992.444719:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789135992.444758:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00080000:2.0:1789135992.445129:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135992.447956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.448062:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644726912 00000100:00100000:0.0:1789135992.448073:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644726912 00000100:00100000:0.0:1789135992.448132:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:0.0:1789135992.448143:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+13:2392:x1876044644726912:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789135992.452507:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135992.452523:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666810496:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789135992.452558:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.452656:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644727040 00000100:00100000:2.0:1789135992.452663:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644727040 00010000:00010000:2.0:1789135992.452697:0:13680:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 14 pid: 8536 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.452752:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:2.0:1789135992.452761:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cfeb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+14:2391:x1876044644727040:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135992.452775:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135992.452781:0:13680:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 14 pid: 8536 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.452794:0:13680:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 14 pid: 8536 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.452821:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fa8d4a9/0x559c8745c6de382b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c32 expref: 14 pid: 8536 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.452840:0:13680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135992.452845:0:13680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135992.452851:0:13680:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.452907:0:13680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.452935:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135992.452996:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cfeb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+13:2391:x1876044644727040:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 235us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.453003:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 114 00010000:00010000:2.0:1789135992.453076:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.453086:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.453097:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.453106:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.453130:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789135992.453145:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789135992.453154:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.453165:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789135992.453171:0:13980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.453182:0:13980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.453197:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.453205:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e50e622/0x559c8745c6de3a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.453235:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135992.453238:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789135992.453240:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135992.453298:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3641:x1876044666810240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9673us (9898us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789135992.453307:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1789135992.453375:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7c86df480/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789135992.453381:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666810240:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789135992.453784:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789135992.453792:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1789135992.453959:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644726912:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 5818us (6011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.453966:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:0.0:1789135992.462070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135992.462148:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644727296 00000100:00100000:3.0:1789135992.462159:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644727296 00000100:00100000:3.0:1789135992.462225:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 245 00000100:00100000:3.0:1789135992.462235:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12726:x1876044644727296:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789135992.462291:0:14528:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.462318:0:14528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3a62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ccc expref: 22 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.462336:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:3.0:1789135992.462342:0:14528:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789135992.462373:0:14528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.462390:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.462413:0:14528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789135992.462551:0:14528:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004b9c0b53 reply state 00000000c3ae34a9 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.462577:0:14528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.462584:0:14528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:3.0:1789135992.462586:0:14528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789135992.462589:0:14528:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789135992.462750:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12726:x1876044644727296:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 514us (687us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789135992.462759:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 245 00000100:00100000:1.0:1789135992.466644:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135992.466721:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644727424 00000100:00100000:3.0:1789135992.466730:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644727424 00000100:00100000:3.0:1789135992.467006:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:3.0:1789135992.467018:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2392:x1876044644727424:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789135992.467172:0:8536:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789135992.467176:0:8536:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789135992 -> 1789135991 00002000:00010000:3.0:1789135992.467178:0:8536:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789135990 00002000:00010000:3.0:1789135992.467180:0:8536:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789135992 -> 1789135991 00002000:00010000:3.0:1789135992.467182:0:8536:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789135992.467236:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644727424:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 220us (611us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789135992.467244:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:1.0:1789135992.471286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.471745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644727680 00000100:00100000:2.0:1789135992.471755:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644727680 00000100:00100000:2.0:1789135992.472005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 246 00000100:00100000:2.0:1789135992.472019:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+23:12726:x1876044644727680:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789135992.472089:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.472106:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.472115:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.472163:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.472176:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 23 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.472191:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666810624:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135992.472324:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789135992.477329:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135992.478250:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644727808 00000100:00100000:1.0:1789135992.478261:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644727808 00010000:00010000:1.0:1789135992.478307:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 24 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.478352:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:1.0:1789135992.478362:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+24:2392:x1876044644727808:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789135992.478396:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789135992.478416:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 24 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.478437:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 24 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.478460:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135992.478466:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.478475:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.478482:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135992.478501:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789135992.478564:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+24:2392:x1876044644727808:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 203us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135992.478572:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 115 00010000:00010000:2.0:1789135992.480513:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e600/0x559c8745c6de3a46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cbe expref: 23 pid: 6517 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.480539:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1876044666810624:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135992.480573:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480584:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480590:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480643:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480651:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480659:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480681:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135992.480686:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480694:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480711:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:2.0:1789135992.480714:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789135992.480718:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.480724:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3a8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.480898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12726:x1876044644727680:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 8881us (9619us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789135992.480908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 246 00000100:00100000:0.0:1789135992.484039:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.484250:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644727936 00000100:00100000:2.0:1789135992.484260:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644727936 00000100:00100000:2.0:1789135992.484310:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:2.0:1789135992.484320:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2390:x1876044644727936:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789135992.484369:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.484391:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.484430:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789135992.484435:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789135992.484439:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.484474:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.484488:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 8 pid: 8430 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.484503:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666810752:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135992.484596:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789135992.491216:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.491348:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8430:1876044666810752:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135992.491383:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.491602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644728064 00000100:00100000:3.0:1789135992.491610:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644728064 00010000:00010000:3.0:1789135992.491661:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 9 pid: 8430 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.491723:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:3.0:1789135992.491733:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+9:2392:x1876044644728064:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135992.491749:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.491770:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 9 pid: 8430 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.491783:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 9 pid: 8430 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.491805:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa69fda/0x559c8745c6de3a70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cda expref: 9 pid: 8430 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.491821:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135992.491826:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789135992.491832:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.491840:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.492116:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135992.492180:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644728064:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 447us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.492188:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 116 00010000:00010000:2.0:1789135992.492507:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492518:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492539:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492555:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492563:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492571:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789135992.492575:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492585:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492599:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.492616:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de3a93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.492693:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644727936:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 8372us (8661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.492702:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1789135992.497307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.497386:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644728320 00000100:00100000:0.0:1789135992.497396:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644728320 00000100:00100000:0.0:1789135992.497457:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 247 00000100:00100000:0.0:1789135992.497468:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+22:12726:x1876044644728320:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789135992.497548:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.497565:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.497575:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.497636:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.497650:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 22 pid: 6516 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.497665:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666810880:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135992.497757:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789135992.503225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.503339:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666810880:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135992.503366:0:8299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.503447:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644728448 00000100:00100000:3.0:1789135992.503454:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644728448 00010000:00010000:3.0:1789135992.503490:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 23 pid: 6516 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.503542:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:3.0:1789135992.503553:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+23:2392:x1876044644728448:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135992.503568:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.503776:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 23 pid: 6516 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.503789:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 23 pid: 6516 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.503813:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3989 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c86 expref: 23 pid: 6516 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.503831:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:3.0:1789135992.503838:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.503849:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.503911:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.503918:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.504006:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135992.504063:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+22:2392:x1876044644728448:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 511us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.504081:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00010000:00010000:2.0:1789135992.505744:0:8299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.505777:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.506039:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.506057:0:8299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 22 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.506066:0:8299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.506103:0:8299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 22 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.506119:0:8299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 22 pid: 14529 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.506147:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666811008:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789135992.506244:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3eca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789135992.514042:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135992.514272:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644728576 00000100:00100000:3.0:1789135992.514281:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644728576 00010000:00010000:3.0:1789135992.514322:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 23 pid: 14529 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789135992.514366:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:3.0:1789135992.514377:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:2392:x1876044644728576:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789135992.514393:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789135992.514400:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 23 pid: 14529 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.514419:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 23 pid: 14529 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.514442:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:3.0:1789135992.514448:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.514457:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.514464:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.514484:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789135992.514544:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:2392:x1876044644728576:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 169us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.514578:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00010000:00010000:0.0:1789135992.514900:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3a54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cc5 expref: 22 pid: 14529 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.514917:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666811008:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789135992.514937:0:8299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.514946:0:8299:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.514950:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789135992.515065:0:8299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789135992.515181:0:8299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789135992.515218:0:8299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789135992.515295:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8299:1876044666811136:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135992.515346:0:8299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135992.515370:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789135992.515549:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666811136 00000100:00100000:3.0:1789135992.515556:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666811136 00000100:00100000:3.0:1789135992.515617:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789135992.515634:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8299:x1876044666811136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789135992.515714:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8299:x1876044666811136:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.515722:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789135992.516456:0:8299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1789135992.516463:0:8299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1789135992.516481:0:8299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7c86df840, transno 4294967322 00000100:00100000:0.0:1789135992.516499:0:8299:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90a7c86df480 x1876044666810240/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789136008 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135992.516510:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8299:1876044666811136:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789135992.516970:0:8299:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789135992.517023:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8299:1876044666811264:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135992.517069:0:8299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135992.517105:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666811264 00000100:00100000:0.0:1789135992.517110:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666811264 00000100:00100000:0.0:1789135992.517148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789135992.517155:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8299:x1876044666811264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789135992.517261:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8299:x1876044666811264:12345-0@lo:1000:mdt00_003.0 Request processed in 106us (190us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789135992.517268:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789135992.517292:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135992.517309:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8299:1876044666811264:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789135992.517343:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.517351:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.517358:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.517364:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.517368:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.517377:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.517393:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:0.0:1789135992.518238:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135992.518246:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518253:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aa1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518280:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518286:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518292:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518297:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.518300:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518306:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518317:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135992.518319:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789135992.518327:0:8299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518339:0:8299:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518347:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.518389:0:8299:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.519229:0:8299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666811392:192.168.201.31@tcp:105: 00000100:00100000:0.0:1789135992.519326:0:8299:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3ecaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789135992.523614:0:8299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8299:1876044666811392:192.168.201.31@tcp:105: 00010000:00010000:0.0:1789135992.523655:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523666:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de39e4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523699:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523714:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523725:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523735:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523741:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523746:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523768:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fe00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.523772:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523779:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523792:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135992.523794:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789135992.523798:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523804:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3aa8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523814:0:8299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523819:0:8299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523824:0:8299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523829:0:8299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ec00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135992.523832:0:8299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523837:0:8299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523898:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135992.523901:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789135992.523905:0:8299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.523911:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ec00/0x559c8745c6de3a9a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.524070:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+25:12726:x1876044644728320:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 26603us (26772us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789135992.524081:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 247 00000020:00080000:0.0:1789135992.524087:0:8299:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789135992.524299:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135992.524304:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135992.524791:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789135992.524801:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135992.529770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135992.529823:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.529950:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644728832 00000100:00100000:0.0:1789135992.529960:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644728832 00000100:00100000:0.0:1789135992.530003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644728960 00000100:00100000:0.0:1789135992.530006:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644728960 00000100:00100000:0.0:1789135992.530022:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:0.0:1789135992.530031:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+26:12726:x1876044644728832:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789135992.530306:0:6519:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789135992.530346:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1789135992.530382:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.530399:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.530409:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.530436:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.530443:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.530448:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.530477:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789135992.530568:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12726:x1876044644728832:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 537us (810us total) trans 4294967516 rc 0/0 00010000:00010000:3.0:1789135992.530685:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789135992.530692:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.530699:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789135992.530703:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.530711:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.530725:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:3.0:1789135992.530727:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789135992.530732:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.530739:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f800/0x559c8745c6de3aaf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135992.530760:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135992.530761:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789135992.530763:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135992.530800:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000020:00080000:0.0:1789135992.530806:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789135992.530824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:0.0:1789135992.530832:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12725:x1876044644728960:12345-192.168.201.31@tcp:49:lfs.0 00000100:00100000:0.0:1789135992.531013:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12725:x1876044644728960:12345-192.168.201.31@tcp:49:lfs.0 Request processed in 181us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.531020:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:1.0:1789135992.537173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135992.537258:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644729216 00000100:00100000:3.0:1789135992.537268:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644729216 00000100:00100000:3.0:1789135992.537331:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 248 00000100:00100000:3.0:1789135992.537341:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12725:x1876044644729216:12345-192.168.201.31@tcp:58:lfs.0 00000040:00080000:3.0:1789135992.537543:0:14528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789135992.537809:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12725:x1876044644729216:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 468us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135992.537818:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 248 00000100:00100000:1.0:1789135992.598991:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135992.599218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644729344 00000100:00100000:2.0:1789135992.599228:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644729344 00000100:00100000:2.0:1789135992.599294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 249 00000100:00100000:2.0:1789135992.599304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+27:12728:x1876044644729344:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135992.599332:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135992.599358:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3ab6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ce1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599433:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599451:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599463:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599481:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599488:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599496:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599575:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599595:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 28 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599605:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599654:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 28 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.599669:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 28 pid: 8299 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789135992.599682:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666811520:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789135992.599799:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789135992.610496:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1876044666811520:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789135992.610535:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135992.613030:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.613142:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644729600 00000100:00100000:0.0:1789135992.613151:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644729600 00000100:00100000:0.0:1789135992.613213:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:0.0:1789135992.613224:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+29:6165:x1876044644729600:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789135992.613481:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+30:6165:x1876044644729600:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 259us (463us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789135992.613489:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:1.0:1789135992.617947:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135992.618117:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644729728 00000100:00100000:0.0:1789135992.618129:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644729728 00010000:00010000:0.0:1789135992.618179:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 30 pid: 8299 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135992.618227:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:0.0:1789135992.618238:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+30:2391:x1876044644729728:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789135992.618255:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789135992.618263:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 30 pid: 8299 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.618278:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 30 pid: 8299 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.618302:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de39d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca2 expref: 30 pid: 8299 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.618320:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135992.618325:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.618345:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.618354:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135992.618387:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789135992.618706:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+29:2391:x1876044644729728:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 468us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135992.618732:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 119 00010000:00010000:2.0:1789135992.619318:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619329:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135992.619384:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789135992.619390:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789135992.619437:0:6516:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619465:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619476:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619482:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619488:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619494:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135992.619498:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619507:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619518:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789135992.619521:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.619525:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619531:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de3abd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619543:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619549:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619561:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619750:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789135992.619755:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619762:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619772:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90a7fa7c3e00) 00010000:00010000:2.0:1789135992.619774:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789135992.619777:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619783:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4200/0x559c8745c6de3ac4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619821:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de3ab6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ce1 expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619830:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ce1 expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135992.619835:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135992.619837:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789135992.619838:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5200, rc 0) 00000100:00100000:2.0:1789135992.620162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12728:x1876044644729344:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 20857us (21182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135992.620182:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 249 00010000:00010000:3.0:1789135993.064488:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789135993.192541:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789135993.582580:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789135993.582590:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789135993.582627:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789135993.582635:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789135993.582775:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666811648:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135993.583070:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e07480 going to sleep for 11 seconds 00000100:00100000:0.0:1789135993.590728:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14496:1876044666811648:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789135993.596092:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135993.598134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644729856 00000100:00100000:2.0:1789135993.598146:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644729856 00000100:00100000:2.0:1789135993.598689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 250 00000100:00100000:2.0:1789135993.598700:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12739:x1876044644729856:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789135993.598737:0:6517:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789135993.598881:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12739:x1876044644729856:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 182us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135993.598889:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 250 00000100:00080000:3.0:1789135993.601924:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789135993.601995:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135993.602024:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644730112 00000100:00100000:3.0:1789135993.602033:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644730112 00000100:00100000:3.0:1789135993.602084:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 251 00000100:00100000:3.0:1789135993.602099:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+28:12739:x1876044644730112:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789135993.602137:0:14529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135993.602159:0:14529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de3ad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ce8 expref: -99 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.602265:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3ad9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.602279:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.602290:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789135993.602302:0:14529:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789135993.602408:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caec00/0x559c8745c6de3ad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ce8 expref: 31 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.603346:0:14529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ce8 expref: 30 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135993.603359:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:3.0:1789135993.603362:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789135993.603365:0:14529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:3.0:1789135993.603536:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+30:12739:x1876044644730112:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1442us (1544us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789135993.603546:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 251 00000100:00100000:2.0:1789135993.612135:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135993.612214:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644730368 00000100:00100000:1.0:1789135993.612235:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644730368 00000100:00100000:1.0:1789135993.612297:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 252 00000100:00100000:1.0:1789135993.612308:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+30:12739:x1876044644730368:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789135993.612397:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612417:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612429:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612836:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612844:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612850:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612893:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135993.612978:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.612988:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.613001:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:1.0:1789135993.613015:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789135993.613020:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135993.613027:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de3ae7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789135993.613176:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+31:12739:x1876044644730368:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 868us (1049us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789135993.613186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 252 00000040:00080000:0.0:1789135993.613807:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789135993.613814:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789135993.616255:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789135993.616273:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789135993.617196:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135993.617310:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644730496 00000100:00100000:2.0:1789135993.617318:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644730496 00000100:00100000:2.0:1789135993.617376:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789135993.617386:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+31:2392:x1876044644730496:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789135993.617401:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789135993.617427:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de3ad9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ce8 expref: 31 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135993.617572:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135993.617577:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789135993.617643:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+30:2392:x1876044644730496:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 258us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135993.617651:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789135993.629143:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135993.639079:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644730752 00000100:00100000:3.0:1789135993.639094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644730752 00000100:00100000:2.0:1789135993.639330:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:2.0:1789135993.639348:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+30:12739:x1876044644730752:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789135993.639738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+31:12739:x1876044644730752:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 390us (10604us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789135993.639758:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000040:00080000:2.0:1789135993.735330:0:15370:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789135993.735339:0:15370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789135993.735369:0:15370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789135993.735375:0:15370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789135994.010114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135994.010156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731008 00000100:00100000:2.0:1789135994.010166:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731008 00000100:00100000:2.0:1789135994.010221:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 253 00000100:00100000:2.0:1789135994.010231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+31:12752:x1876044644731008:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789135994.010255:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789135994.010277:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de3aee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135994.010403:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3af5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135994.010430:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3af5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135994.010443:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3af5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789135994.010455:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789135994.010555:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de3aee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cef expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135994.010593:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3af5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cef expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789135994.010615:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789135994.010618:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789135994.010622:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5600, rc 0) 00000100:00100000:2.0:1789135994.010677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+33:12752:x1876044644731008:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 448us (573us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789135994.010684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 253 00000100:00100000:3.0:1789135994.025178:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789135994.025272:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731136 00000100:00100000:0.0:1789135994.025282:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731136 00000100:00100000:0.0:1789135994.025367:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 254 00000100:00100000:0.0:1789135994.025379:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+33:12752:x1876044644731136:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:0.0:1789135994.025460:0:14529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025479:0:14529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025490:0:14529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025525:0:14529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025532:0:14529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025539:0:14529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025545:0:14529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fe00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789135994.025556:0:14529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025565:0:14529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025578:0:14529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:0.0:1789135994.025581:0:14529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789135994.025585:0:14529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789135994.025592:0:14529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3fe00/0x559c8745c6de3b03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789135994.025679:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+33:12752:x1876044644731136:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 301us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135994.025687:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 254 00010000:00010000:0.0:1789135994.088021:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135994.127166:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789135994.127293:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731264 00000100:00100000:3.0:1789135994.127317:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731264 00000100:00100000:3.0:1789135994.127417:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:3.0:1789135994.127429:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644731264:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:3.0:1789135994.127458:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789135994.127495:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3b0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cf6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789135994.127611:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1789135994.127937:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa40c77, atime: 0x6aa40c76, ctime: 0x6aa40c77, blocks: 0x8 00010000:00010000:3.0:1789135994.127968:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1789135994.127973:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789135994.127987:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3b0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cf6 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135994.128012:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3b0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cf6 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789135994.128027:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caec00, rc 0) 00000100:00100000:3.0:1789135994.128154:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2391:x1876044644731264:12345-192.168.201.31@tcp:101:cat.0 Request processed in 727us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.128163:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:2.0:1789135994.141233:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135994.141803:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731392 00000100:00100000:1.0:1789135994.141814:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731392 00002000:00100000:1.0:1789135994.141989:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90a6c4547840 x1876044644731392/t0(0) o3->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:425/0 lens 488/0 e 0 to 0 dl 1789136005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135994.142002:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c4547840 with x1876044644731392 ext(0->4095) 00002000:00010000:1.0:1789135994.142009:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c4547840 00000100:00100000:1.0:1789135994.142053:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1789135994.142065:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644731392:12345-192.168.201.31@tcp:3:cat.0 00000100:00100000:1.0:1789135994.142245:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4547840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2392:x1876044644731392:12345-192.168.201.31@tcp:3:cat.0 Request processed in 182us (1020us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789135994.142253:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00002000:00100000:1.0:1789135994.142259:0:8436:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90a6c4547840 x1876044644731392/t0(0) o3->50163b70-8f7a-42d3-bcbf-652648370aa8@192.168.201.31@tcp:425/0 lens 488/4536 e 0 to 0 dl 1789136005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789135994.142267:0:8436:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c4547840 with x1876044644731392 ext(0->4095) 00002000:00010000:1.0:1789135994.142270:0:8436:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90a6c4547840 00000100:00100000:2.0:1789135994.217611:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666811776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789135994.217700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.218162:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666811776 00000100:00100000:0.0:1789135994.218171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666811776 00000100:00100000:0.0:1789135994.218231:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789135994.218240:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c45470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666811776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135994.218277:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789135994.218350:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c45470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666811776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135994.218358:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789135994.218530:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666811776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135994.728246:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666811904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135994.728323:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.728899:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666812416:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.728945:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.728965:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666812928:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.728988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.729013:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789135994.729019:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666812032:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.729043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.729062:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666812544:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.729081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.729094:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666813056:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.729111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135994.729135:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812416 00000100:00100000:0.0:1789135994.729141:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812416 00000100:00100000:0.0:1789135994.729185:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789135994.729194:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666812416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.729247:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666812416:12345-0@lo:400:kworker.0 Request processed in 54us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135994.729255:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789135994.729299:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666812416:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.729384:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666811904 00000100:00100000:3.0:1789135994.729389:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666811904 00000100:00100000:3.0:1789135994.729896:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789135994.729905:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666811904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789135994.729942:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135994.729989:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666811904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.729995:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789135994.730020:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812032 00000100:00100000:3.0:1789135994.730024:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812032 00000100:00100000:3.0:1789135994.730046:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1789135994.730052:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666812032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730083:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666812032:12345-0@lo:400:kworker.0 Request processed in 31us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.730089:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1789135994.730121:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666812288:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.730168:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666812800:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.730204:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666813312:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.730238:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789135994.730244:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666812160:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.730282:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666812672:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.730316:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666813184:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.730336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789135994.730360:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812928 00000100:00100000:3.0:1789135994.730370:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812928 00000100:00100000:3.0:1789135994.730397:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812544 00000100:00100000:2.0:1789135994.731133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813056 00000100:00100000:2.0:1789135994.731138:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813056 00000100:00100000:2.0:1789135994.731162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812288 00000100:00100000:2.0:1789135994.731164:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812288 00000100:00100000:2.0:1789135994.731175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812160 00000100:00100000:2.0:1789135994.731178:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812160 00000100:00100000:2.0:1789135994.731188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812672 00000100:00100000:2.0:1789135994.731190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812672 00000100:00100000:2.0:1789135994.731206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1789135994.731213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666812928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.731272:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666812928:12345-0@lo:400:kworker.0 Request processed in 59us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.731279:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1789135994.731304:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789135994.731309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666813056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.731337:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666813056:12345-0@lo:400:kworker.0 Request processed in 28us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.731343:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789135994.731355:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789135994.731360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666812288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.731395:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666812288:12345-0@lo:400:kworker.0 Request processed in 35us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.732770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789135994.732806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789135994.732819:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666812160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.732898:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666812160:12345-0@lo:400:kworker.0 Request processed in 83us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.732906:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789135994.732919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789135994.732926:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666812672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.732953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666812672:12345-0@lo:400:kworker.0 Request processed in 29us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.732959:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789135994.732987:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666812800 00000100:00100000:2.0:1789135994.732992:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812800 00000100:00100000:2.0:1789135994.733028:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813312 00000100:00100000:2.0:1789135994.733031:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813312 00000100:00100000:2.0:1789135994.733045:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813184 00000100:00100000:2.0:1789135994.733048:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813184 00000100:00100000:2.0:1789135994.733060:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135994.733077:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666812800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733110:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666812800:12345-0@lo:400:kworker.0 Request processed in 36us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.733117:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789135994.733128:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789135994.733133:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666813312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733160:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666813312:12345-0@lo:400:kworker.0 Request processed in 27us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.733166:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789135994.733176:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789135994.733182:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666813184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733207:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666813184:12345-0@lo:400:kworker.0 Request processed in 25us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789135994.733212:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789135994.733312:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666812160:0@lo:400:kworker.0 00010000:00080000:2.0:1789135994.733329:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe12c0 x1876044666812672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789135994.733340:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666812672:0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733350:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666813184:0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733360:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666812288:0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733371:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666812800:0@lo:400:kworker.0 00000100:00100000:2.0:1789135994.733383:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666813312:0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.733743:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666812544 00000100:00100000:3.0:1789135994.733794:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789135994.733800:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666812544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789135994.733839:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666812544:12345-0@lo:400:kworker.0 Request processed in 39us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.733844:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1789135994.734081:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789135994.734105:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666813440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789135994.734144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135994.734366:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135994.734373:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135994.734376:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135994.734378:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135994.735685:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666812032:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.735707:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666812544:0@lo:400:kworker.0 00010000:00080000:0.0:1789135994.735721:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe1a40 x1876044666813056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789135994.735745:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666813056:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.735769:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666812928:0@lo:400:kworker.0 00000100:00100000:0.0:1789135994.735790:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666811904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789135994.736172:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813440 00000100:00100000:3.0:1789135994.736181:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813440 00000100:00100000:3.0:1789135994.736225:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789135994.738998:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666813440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789135994.739029:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789135994.739378:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666813440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3143us (5231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135994.739387:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789135994.745771:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4545a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666813440:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789135995.112332:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135995.240618:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666813568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789135995.240697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135995.240780:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813568 00000100:00100000:0.0:1789135995.240787:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813568 00000100:00100000:0.0:1789135995.240830:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789135995.240839:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666813568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789135995.240881:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789135995.240921:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666813568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135995.240928:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789135995.240965:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666813568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789135995.241408:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666813696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789135995.241439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135995.241540:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813696 00000100:00100000:0.0:1789135995.241545:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813696 00000100:00100000:0.0:1789135995.241573:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789135995.241590:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666813696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789135995.241601:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789135995.241638:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666813696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135995.241643:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789135995.241704:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666813696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789135995.754369:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666813824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789135995.754444:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135995.754909:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813824 00000100:00100000:0.0:1789135995.754927:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813824 00000100:00100000:0.0:1789135995.754982:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789135995.754992:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666813824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789135995.755039:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789135995.755097:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4547c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666813824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135995.755103:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789135995.755265:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666813824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789135996.139130:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789135996.411361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135996.411415:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135996.411457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135996.411491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135996.411508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135996.411526:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789135996.411567:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789135996.411746:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732032 00000100:00100000:1.0:1789135996.411757:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732032 00000100:00100000:1.0:1789135996.411829:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731904 00000100:00100000:1.0:1789135996.411833:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731904 00000100:00100000:1.0:1789135996.411893:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:1.0:1789135996.411903:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2389:x1876044644732032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135996.411979:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+8:2389:x1876044644732032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 77us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135996.412002:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:1.0:1789135996.412029:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 155 00000100:00100000:1.0:1789135996.412036:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4518b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644731904:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789135996.412061:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4518b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644731904:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135996.412066:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 155 00000100:00080000:1.0:1789135996.412083:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789135996.412087:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789135996.412771:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731520 00000100:00100000:3.0:1789135996.412779:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731520 00000100:00100000:3.0:1789135996.412830:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 469 00000100:00100000:3.0:1789135996.412837:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644731520:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789135996.412898:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+13:2389:x1876044644731520:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 61us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789135996.412904:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 469 00000100:00100000:0.0:1789135996.418638:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731776 00000100:00100000:0.0:1789135996.418655:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731776 00000100:00100000:0.0:1789135996.422592:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732288 00000100:00100000:0.0:1789135996.422606:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732288 00000100:00100000:0.0:1789135996.422643:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644731648 00000100:00100000:0.0:1789135996.422647:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644731648 00000100:00100000:0.0:1789135996.422662:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732160 00000100:00100000:0.0:1789135996.422665:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732160 00000100:00100000:0.0:1789135996.422686:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 417 00000100:00100000:0.0:1789135996.422696:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644731776:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135996.422779:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4545a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2389:x1876044644731776:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 84us (11363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.422796:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 417 00000100:00100000:0.0:1789135996.422815:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 418 00000100:00100000:0.0:1789135996.422822:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644732288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135996.422846:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644732288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (11355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.422869:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 418 00000100:00100000:0.0:1789135996.422883:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 419 00000100:00100000:0.0:1789135996.422889:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+33:2389:x1876044644731648:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135996.422933:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4491e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+33:2389:x1876044644731648:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 45us (11424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.422940:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 419 00000100:00100000:0.0:1789135996.422951:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 420 00000100:00100000:0.0:1789135996.422957:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644732160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789135996.422978:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4519e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2389:x1876044644732160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (11413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135996.422998:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 420 00000100:00080000:0.0:1789135996.423037:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135996.423042:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1789135996.780705:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1789135997.167536:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789135997.812578:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789135997.812613:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a6c3ecac00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789135997.812619:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a6c3e2fb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c3eca9c0 00000020:00080000:0.0:1789135997.812622:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a6c3e2fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c3f52200 00000020:00080000:0.0:1789135997.812643:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789135997.812682:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789135997.812760:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789135997.812810:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.812822:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.812841:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.812847:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789135997.812851:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.812891:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.812907:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90a7fa5a1900) 00010000:00010000:1.0:1789135997.812910:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789135997.812914:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789135997.812921:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de3a85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14528 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789135997.813221:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1789135997.813228:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:3.0:1789135998.184116:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789135999.209043:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789135999.344123:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789135999.344147:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666813952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135999.344214:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.344273:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666813952 00000100:00100000:0.0:1789135999.344279:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666813952 00000100:00100000:0.0:1789135999.344320:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789135999.344328:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666813952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789135999.344358:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789135999.344412:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666813952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135999.344419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789135999.344462:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666813952:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789135999.856209:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666814080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135999.856296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.856519:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814080 00000100:00100000:0.0:1789135999.856526:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814080 00000100:00100000:0.0:1789135999.856592:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789135999.856602:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666814080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789135999.856632:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135999.856677:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666814080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135999.856683:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789135999.856707:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666814208:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.856738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.856761:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666814720:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.856786:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.856803:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666815232:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.856823:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.856841:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789135999.856847:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666814336:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.856890:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.856908:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666814848:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.856927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.856969:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f671d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666815360:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.856993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.859735:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666814592:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.859811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.859847:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666815104:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.859884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.859906:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666815616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135999.859929:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.859975:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666814080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789135999.859997:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789135999.860004:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666814464:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.860029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.860046:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666814976:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.860068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789135999.860084:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666815488:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.860102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789135999.860125:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135999.860139:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815616 00000100:00100000:0.0:1789135999.860144:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815616 00000100:00100000:0.0:1789135999.860193:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135999.860201:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666815616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789135999.860223:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789135999.860261:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666815616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135999.860268:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789135999.860310:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814208 00000100:00100000:0.0:1789135999.860314:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814208 00000100:00100000:0.0:1789135999.860341:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789135999.860347:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666814208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.860383:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666814208:12345-0@lo:400:kworker.0 Request processed in 37us (3645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789135999.860389:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789135999.860418:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814720 00000100:00100000:0.0:1789135999.860421:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814720 00000100:00100000:0.0:1789135999.860442:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815232 00000100:00100000:0.0:1789135999.860445:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815232 00000100:00100000:0.0:1789135999.860459:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814336 00000100:00100000:0.0:1789135999.860462:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814336 00000100:00100000:0.0:1789135999.860473:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814848 00000100:00100000:0.0:1789135999.860475:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814848 00000100:00100000:0.0:1789135999.860484:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815104 00000100:00100000:0.0:1789135999.860486:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815104 00000100:00100000:0.0:1789135999.860511:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814464 00000100:00100000:0.0:1789135999.860514:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814464 00000100:00100000:0.0:1789135999.860526:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1789135999.860998:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814592 00000100:00100000:1.0:1789135999.861003:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814592 00000100:00100000:1.0:1789135999.861049:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789135999.861056:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666814592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.861097:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666814592:12345-0@lo:400:kworker.0 Request processed in 42us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.861102:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789135999.865627:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815360 00000100:00100000:1.0:1789135999.865644:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815360 00000100:00100000:1.0:1789135999.865712:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666814976 00000100:00100000:1.0:1789135999.865715:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666814976 00000100:00100000:1.0:1789135999.865756:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815488 00000100:00100000:1.0:1789135999.865760:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815488 00000100:00100000:1.0:1789135999.865782:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135999.865791:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666815360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.865911:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666815360:12345-0@lo:400:kworker.0 Request processed in 120us (8916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.865918:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789135999.865939:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789135999.865945:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666814976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.865977:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666814976:12345-0@lo:400:kworker.0 Request processed in 32us (5908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.865983:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789135999.865995:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789135999.866001:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666815488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.866029:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666815488:12345-0@lo:400:kworker.0 Request processed in 29us (5926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.866035:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1789135999.866206:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789135999.866211:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789135999.866213:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789135999.866216:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789135999.866250:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789135999.866257:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789135999.866293:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7f671f0c0, transno 4294967311 00000100:00100000:0.0:1789135999.866325:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666814976:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.866339:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789135999.866343:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7c86df480, transno 4294967323 00000004:00080000:0.0:1789135999.866359:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789135999.866375:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666815488:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.866389:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666814592:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.866408:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666815616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789135999.866448:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f671d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666815360:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.866460:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666814208:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.866630:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666814720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.866675:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666814720:12345-0@lo:400:kworker.0 Request processed in 479us (9887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.871055:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1789135999.871078:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1789135999.871091:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666814336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.871182:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666814336:12345-0@lo:400:kworker.0 Request processed in 97us (14291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.871190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1789135999.871214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1789135999.871221:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666814848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.871252:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666814848:12345-0@lo:400:kworker.0 Request processed in 32us (14324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.871268:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1789135999.871281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789135999.871287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666815104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.875656:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666815104:12345-0@lo:400:kworker.0 Request processed in 4358us (15760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.875670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789135999.875705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789135999.875716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d03861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666814464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.875769:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d03861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666814464:12345-0@lo:400:kworker.0 Request processed in 59us (15740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.875773:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789135999.875809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666815232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.875873:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666815232:12345-0@lo:400:kworker.0 Request processed in 4776us (19018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789135999.875880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789135999.877933:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666814336:0@lo:400:kworker.0 00010000:00080000:3.0:1789135999.877952:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe0b40 x1876044666814848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135999.877962:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666814848:0@lo:400:kworker.0 00000100:00100000:3.0:1789135999.877974:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666814720:0@lo:400:kworker.0 00010000:00080000:3.0:1789135999.877985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c2fe12c0 x1876044666815232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789135999.877994:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666815232:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.879020:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666814464:0@lo:400:kworker.0 00000100:00100000:1.0:1789135999.879036:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666815104:0@lo:400:kworker.0 00000100:00100000:0.0:1789135999.880879:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00010000:00010000:0.0:1789136000.231973:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136000.361361:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666815744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136000.361450:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136000.361814:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136000.361823:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666815872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136000.361869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136000.362546:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815744 00000100:00100000:0.0:1789136000.362557:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815744 00000100:00100000:0.0:1789136000.362610:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666815872 00000100:00100000:0.0:1789136000.362614:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666815872 00000100:00100000:0.0:1789136000.362630:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789136000.362638:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666815744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136000.362668:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789136000.362730:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666815744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136000.362739:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789136000.362756:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789136000.362762:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666815872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789136000.362772:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789136000.362816:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666815872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136000.362823:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789136000.362950:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666815872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136000.362965:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666815744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136000.475758:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136000.475908:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732416 00000100:00100000:0.0:1789136000.475922:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732416 00000100:00100000:0.0:1789136000.476036:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 255 00000100:00100000:0.0:1789136000.476051:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:12413:x1876044644732416:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1789136000.476068:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136000.476194:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:12413:x1876044644732416:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 146us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136000.476202:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 255 00000100:00100000:0.0:1789136000.488782:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136000.488890:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732544 00000100:00100000:3.0:1789136000.488902:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732544 00000100:00100000:3.0:1789136000.489025:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 256 00000100:00100000:3.0:1789136000.489039:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+5:12413:x1876044644732544:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789136000.489172:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:50163b70-8f7a-42d3-bcbf-652648370aa8+5:12413:x1876044644732544:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 137us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136000.489180:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 256 00000100:00080000:2.0:1789136000.489539:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136000.510381:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136000.510587:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732800 00000100:00100000:0.0:1789136000.510600:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732800 00000100:00100000:0.0:1789136000.510682:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:0.0:1789136000.510696:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:12413:x1876044644732800:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789136000.511110:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:12413:x1876044644732800:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 416us (745us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789136000.511119:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:1.0:1789136000.716232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136000.716363:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644732928 00000100:00100000:0.0:1789136000.716377:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644732928 00000100:00100000:0.0:1789136000.716510:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 257 00000100:00100000:0.0:1789136000.716522:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+5:13210:x1876044644732928:12345-192.168.201.31@tcp:101:lsof.0 00010000:00010000:0.0:1789136000.716548:0:8299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136000.716574:0:8299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3b11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08cfd expref: -99 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136000.716682:0:8299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3b18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136000.716699:0:8299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136000.716724:0:8299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136000.716787:0:8299:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789136000.716791:0:8299:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136000.716817:0:8299:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8299 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136000.716844:0:8299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f400/0x559c8745c6de3b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cfd expref: 7 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136000.716901:0:8299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3b18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cfd expref: 6 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136000.716912:0:8299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:0.0:1789136000.716915:0:8299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136000.716920:0:8299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3ea00, rc 0) 00000100:00100000:0.0:1789136000.717002:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8cf048c-d8c6-435a-a255-87c185db70f0+6:13210:x1876044644732928:12345-192.168.201.31@tcp:101:lsof.0 Request processed in 482us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136000.717010:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 257 00000100:00080000:2.0:1789136000.718661:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136000.872168:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136000.873894:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666816000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136000.874037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136000.874319:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816000 00000100:00100000:0.0:1789136000.874331:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816000 00000100:00100000:0.0:1789136000.874415:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789136000.874426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666816000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136000.874536:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789136000.874607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666816000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136000.874616:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789136000.877735:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666816000:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136001.256184:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136001.531176:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531342:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531392:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531421:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136001.531478:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733312 00000100:00100000:3.0:1789136001.531634:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733312 00000100:00100000:3.0:1789136001.531720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733824 00000100:00100000:3.0:1789136001.531724:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733824 00000100:00100000:3.0:1789136001.531759:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733184 00000100:00100000:3.0:1789136001.531762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733184 00000100:00100000:3.0:1789136001.531777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733696 00000100:00100000:3.0:1789136001.531780:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733696 00000100:00100000:3.0:1789136001.531801:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 427 00000100:00100000:3.0:1789136001.531814:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644733312:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:2.0:1789136001.532030:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136001.532080:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 428 00000100:00100000:2.0:1789136001.532092:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644733824:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136001.532177:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644733824:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 89us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136001.532187:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 428 00000100:00100000:2.0:1789136001.532214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 429 00000100:00100000:2.0:1789136001.532221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:2391:x1876044644733184:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136001.532273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+20:2391:x1876044644733184:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 52us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136001.532281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 429 00000100:00100000:2.0:1789136001.532295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 430 00000100:00100000:2.0:1789136001.532302:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644733696:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136001.532329:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644733696:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136001.532336:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 430 00000100:00100000:1.0:1789136001.532474:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733568 00000100:00100000:1.0:1789136001.532482:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733568 00000100:00100000:1.0:1789136001.532544:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733440 00000100:00100000:1.0:1789136001.532547:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733440 00000100:00100000:1.0:1789136001.532573:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:1.0:1789136001.532580:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644733568:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136001.532616:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2391:x1876044644733568:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 36us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136001.532622:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:1.0:1789136001.532638:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:1.0:1789136001.532644:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6410b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644733440:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136001.532667:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6410b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644733440:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136001.532673:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:3.0:1789136001.533206:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2391:x1876044644733312:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 1393us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136001.533215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 427 00000100:00100000:0.0:1789136001.533305:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733056 00000100:00100000:0.0:1789136001.533311:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733056 00000100:00100000:0.0:1789136001.533355:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 471 00000100:00100000:0.0:1789136001.533364:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644733056:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136001.533397:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+13:2391:x1876044644733056:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 35us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136001.533404:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 471 00000100:00080000:2.0:1789136001.533511:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136001.533516:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789136002.282957:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136003.304091:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136003.432653:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789136003.880512:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789136003.880525:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136003.890496:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1789136003.890517:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789136003.901374:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1789136003.901408:0:6494:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789136003.901800:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789136003.901815:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789136004.330991:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136004.457705:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136004.457737:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666816128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136004.457838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136004.458131:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816128 00000100:00100000:0.0:1789136004.458142:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816128 00000100:00100000:0.0:1789136004.458215:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789136004.458226:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666816128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136004.458273:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789136004.458338:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6412d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666816128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.458346:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789136004.458401:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666816128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136004.969106:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d0384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666816256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136004.969365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136004.969443:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816256 00000100:00100000:2.0:1789136004.969450:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666816768:0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.969452:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816256 00000100:00100000:2.0:1789136004.969489:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136004.969516:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789136004.969522:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666817280:0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.969530:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666816256:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136004.969552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.969574:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666817792:0@lo:400:kworker.0 00002000:00000024:1.0:1789136004.969582:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789136004.969603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136004.969637:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666816256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136004.969644:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789136004.969730:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d0384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666816256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136004.969746:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789136004.969754:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666816384:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.969783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.969828:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666816896:0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.969851:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816384 00000100:00100000:1.0:1789136004.969874:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816384 00000100:00100000:2.0:1789136004.969882:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.969904:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666817408:0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.969907:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789136004.969918:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666816384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.969934:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.969961:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666817920:0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.969963:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666816384:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136004.969972:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789136004.969991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.970020:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666816384:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.970045:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666816640:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.970297:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666816512:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.970324:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136004.970363:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666817024:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.970387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136004.970416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666817536:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.970438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136004.970456:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666818048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136004.970464:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816768 00000100:00100000:1.0:1789136004.970469:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816768 00000100:00100000:0.0:1789136004.970479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136004.970505:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816512 00000100:00100000:1.0:1789136004.970509:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816512 00000100:00100000:0.0:1789136004.970512:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818048 00000100:00100000:0.0:1789136004.970518:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818048 00000100:00100000:1.0:1789136004.970531:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817024 00000100:00100000:1.0:1789136004.970545:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817024 00000100:00100000:0.0:1789136004.970552:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789136004.970561:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666818048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136004.970567:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817536 00000100:00100000:1.0:1789136004.970571:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817536 00002000:00000024:0.0:1789136004.970576:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789136004.970589:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789136004.970598:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666816768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.970618:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666818048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.970626:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789136004.970647:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666816768:12345-0@lo:400:kworker.0 Request processed in 49us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136004.970654:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1789136004.970673:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789136004.970680:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.970689:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666818048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136004.970718:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0386940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666816512:12345-0@lo:400:kworker.0 Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.970722:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666816512:0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.970729:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789136004.970747:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789136004.970755:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666817024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.970797:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666817024:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136004.970810:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789136004.970822:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1789136004.970827:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666817536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136004.970874:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666817536:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136004.970879:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789136004.971018:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666817024:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.971029:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666817536:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.971298:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817280 00000100:00100000:0.0:1789136004.971303:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817280 00000100:00100000:0.0:1789136004.971324:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817792 00000100:00100000:0.0:1789136004.971327:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817792 00000100:00100000:0.0:1789136004.971340:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817408 00000100:00100000:0.0:1789136004.971342:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817408 00000100:00100000:0.0:1789136004.971351:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817920 00000100:00100000:0.0:1789136004.971360:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817920 00000100:00100000:0.0:1789136004.971377:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789136004.971384:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666817280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.971432:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666817280:12345-0@lo:400:kworker.0 Request processed in 48us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.971439:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789136004.971451:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789136004.971457:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666817792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.971484:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666817792:12345-0@lo:400:kworker.0 Request processed in 28us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.971491:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789136004.971502:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789136004.971508:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.971534:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666817408:12345-0@lo:400:kworker.0 Request processed in 26us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.971539:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789136004.971550:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789136004.971556:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666817920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.971579:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666817920:12345-0@lo:400:kworker.0 Request processed in 24us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.971585:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789136004.971604:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816896 00000100:00100000:0.0:1789136004.971607:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816896 00000100:00100000:2.0:1789136004.971742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136004.973143:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666817408:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.973170:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666817920:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.974006:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666816768:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.974025:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666817280:0@lo:400:kworker.0 00000100:00100000:3.0:1789136004.974036:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666817792:0@lo:400:kworker.0 00000100:00080000:3.0:1789136004.974165:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136004.974171:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136004.974313:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136004.976696:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666817152:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.976769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.976794:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666817664:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.976816:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136004.976874:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817152 00000100:00100000:2.0:1789136004.976881:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817152 00000100:00100000:2.0:1789136004.976938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666817664 00000100:00100000:2.0:1789136004.976941:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666817664 00000100:00100000:2.0:1789136004.976965:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789136004.976974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666817152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.977027:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666817152:12345-0@lo:400:kworker.0 Request processed in 54us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136004.977034:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789136004.977076:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789136004.977083:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666817664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.977112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666817664:12345-0@lo:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136004.977130:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00080000:2.0:1789136004.977155:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789136004.977196:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92580 x1876044666817152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136004.977211:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666817152:0@lo:400:kworker.0 00010000:00080000:2.0:1789136004.977223:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92d00 x1876044666817664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136004.977231:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666817664:0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.979829:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666816640 00000100:00100000:0.0:1789136004.979844:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666816640 00000100:00100000:0.0:1789136004.979918:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789136004.979929:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666816896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.980070:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666816896:12345-0@lo:400:kworker.0 Request processed in 128us (10173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.980079:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789136004.980099:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789136004.980106:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666816640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136004.980142:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666816640:12345-0@lo:400:kworker.0 Request processed in 37us (8400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136004.980149:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789136004.980840:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666816896:0@lo:400:kworker.0 00000100:00100000:2.0:1789136004.980924:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666816640:0@lo:400:kworker.0 00000001:02000400:2.0:1789136005.103439:0:15568:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:13:22 (1789136002) 00010000:00010000:2.0:1789136005.365099:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136005.490264:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666818176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136005.490346:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136005.490438:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666818304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136005.490464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136005.490500:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818176 00000100:00100000:1.0:1789136005.490507:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818176 00000100:00100000:1.0:1789136005.490550:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818304 00000100:00100000:1.0:1789136005.490553:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818304 00000100:00100000:1.0:1789136005.490568:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789136005.490576:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666818176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136005.490606:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789136005.490651:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666818176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136005.490659:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789136005.490679:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789136005.490686:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666818304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136005.490696:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789136005.490725:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666818304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136005.490747:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789136005.490795:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666818176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136005.490825:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666818304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136005.992315:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666818432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136005.992407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136005.992594:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818432 00000100:00100000:0.0:1789136005.992602:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818432 00000100:00100000:0.0:1789136005.992654:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789136005.992664:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666818432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136005.992697:0:7824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789136005.992756:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666818432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136005.992774:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789136005.993014:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6411680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666818432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789136006.376408:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136006.641235:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136006.641286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136006.641322:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136006.641359:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136006.641393:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734208 00000100:00100000:3.0:1789136006.641400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136006.641404:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734208 00000100:00100000:3.0:1789136006.641434:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136006.641466:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734720 00000100:00100000:3.0:1789136006.641467:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136006.641470:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734720 00000100:00100000:2.0:1789136006.641496:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734080 00000100:00100000:2.0:1789136006.641499:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734080 00000100:00100000:3.0:1789136006.641500:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734592 00000100:00100000:3.0:1789136006.641505:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734592 00000100:00100000:2.0:1789136006.641532:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 437 00000100:00100000:0.0:1789136006.641586:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644733952 00000100:00100000:0.0:1789136006.641591:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644733952 00000100:00100000:0.0:1789136006.641621:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 473 00000100:00100000:0.0:1789136006.641629:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644733952:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136006.641699:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f56ac69e-f262-403a-94d3-403db5052814+13:2390:x1876044644733952:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 71us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136006.641707:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 473 00000100:00100000:1.0:1789136006.641710:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734464 00000100:00100000:1.0:1789136006.641716:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734464 00000100:00100000:1.0:1789136006.641754:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734336 00000100:00100000:1.0:1789136006.641758:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734336 00000100:00100000:1.0:1789136006.641786:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:1.0:1789136006.641794:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6410780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644734464:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136006.641830:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6410780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2390:x1876044644734464:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 37us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136006.641837:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:1.0:1789136006.641887:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:1.0:1789136006.641895:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6411e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644734336:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136006.641927:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6411e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644734336:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136006.641935:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:2.0:1789136006.642050:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644734208:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136006.642091:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6411a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2390:x1876044644734208:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 45us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136006.647894:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 438 00000100:00100000:3.0:1789136006.647912:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644734720:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136006.648008:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2390:x1876044644734720:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 104us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136006.648016:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 438 00000100:00100000:3.0:1789136006.648045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 439 00000100:00100000:3.0:1789136006.648053:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:2390:x1876044644734080:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136006.648090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6412580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+19:2390:x1876044644734080:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 38us (6693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136006.648096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 439 00000100:00100000:3.0:1789136006.648115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 440 00000100:00100000:3.0:1789136006.648121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2390:x1876044644734592:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136006.648138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2390:x1876044644734592:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 18us (6673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136006.648144:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 440 00000100:00080000:3.0:1789136006.648200:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789136006.648205:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136006.648208:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136006.648211:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136006.659448:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 437 00010000:00010000:2.0:1789136007.400763:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136008.424175:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136009.448066:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136009.576447:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136009.576483:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6413c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666818560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136009.576575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136009.576630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818560 00000100:00100000:1.0:1789136009.576643:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818560 00000100:00100000:1.0:1789136009.576723:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789136009.576736:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666818560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136009.576786:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789136009.576914:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666818560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 180us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136009.576924:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789136009.576990:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6413c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666818560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136010.088192:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d03852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666818688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136010.088290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136010.088380:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666819328:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.088410:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136010.088439:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789136010.088447:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666818944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136010.088472:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136010.088489:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666819456:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.088516:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136010.088550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819328 00000100:00100000:3.0:1789136010.088558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819328 00000100:00100000:3.0:1789136010.088608:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1789136010.088618:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666819328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.088701:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6411680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666819328:12345-0@lo:400:kworker.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136010.088709:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1789136010.088743:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666818816:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.088776:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136010.089042:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666819840:0@lo:400:kworker.0 00000100:00100000:2.0:1789136010.089110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136010.089767:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666819968:0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.089836:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136010.089917:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666819072:0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.089944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136010.089968:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666819584:0@lo:400:kworker.0 00000100:00100000:2.0:1789136010.090038:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666820352:0@lo:400:kworker.0 00000100:00100000:2.0:1789136010.090087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136010.090159:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666819328:0@lo:400:kworker.0 00000100:00100000:2.0:1789136010.090248:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819968 00000100:00100000:2.0:1789136010.090254:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819968 00000100:00100000:3.0:1789136010.090259:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666819200:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.090276:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819072 00000100:00100000:1.0:1789136010.090285:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819072 00000100:00100000:3.0:1789136010.090318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136010.090346:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666819712:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.090350:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789136010.090359:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666819072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136010.090373:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1789136010.090382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136010.090392:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f671f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666819968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.090417:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666820224:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.090418:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666819072:12345-0@lo:400:kworker.0 Request processed in 58us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136010.090426:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789136010.090464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136010.090473:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f671f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666819968:12345-0@lo:400:kworker.0 Request processed in 85us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136010.090484:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00080000:3.0:1789136010.090510:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136010.090524:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819712 00000100:00100000:3.0:1789136010.090527:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819712 00000100:00100000:0.0:1789136010.090533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136010.090553:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666820096:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.090556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819584 00000100:00100000:3.0:1789136010.090558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819584 00000100:00100000:0.0:1789136010.090573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136010.090575:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1789136010.090581:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.090601:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666819072:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.090618:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666819712:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136010.090627:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1789136010.090640:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820096 00000100:00100000:2.0:1789136010.090648:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820096 00000100:00100000:3.0:1789136010.090657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1789136010.090670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666819584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136010.090684:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1789136010.090705:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666819584:12345-0@lo:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136010.090727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:3.0:1789136010.090746:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136010.090749:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136010.090764:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666820096:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789136010.090778:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ceb0c0 x1876044666819712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136010.090792:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666819712:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.090798:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818688 00000100:00100000:1.0:1789136010.090803:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818688 00000100:00100000:2.0:1789136010.090825:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666820096:12345-0@lo:400:kworker.0 Request processed in 66us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136010.090836:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789136010.090872:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818944 00000100:00100000:1.0:1789136010.090877:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818944 00000100:00100000:3.0:1789136010.090879:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819840 00000100:00100000:3.0:1789136010.090883:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819840 00000100:00100000:1.0:1789136010.090905:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789136010.090911:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820352 00000100:00100000:1.0:1789136010.090912:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666818688:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136010.090914:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820352 00000100:00100000:3.0:1789136010.090937:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820224 00000100:00100000:3.0:1789136010.090940:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820224 00002000:00000024:1.0:1789136010.090941:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789136010.090958:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666819968:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.090961:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789136010.090997:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666818816 00000100:00100000:2.0:1789136010.091004:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666818816 00000100:00100000:2.0:1789136010.091052:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1789136010.091059:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.091322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666819584:0@lo:400:kworker.0 00010000:00080000:0.0:1789136010.091337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d92d00 x1876044666820096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136010.091346:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666820096:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.091403:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666819840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.091412:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f64103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666818688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 502us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136010.091419:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789136010.091440:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666819840:12345-0@lo:400:kworker.0 Request processed in 43us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.091512:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789136010.091521:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666820352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.091555:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666820352:12345-0@lo:400:kworker.0 Request processed in 37us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.091562:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789136010.091575:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789136010.091581:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4466d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666820224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.091614:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4466d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666820224:12345-0@lo:400:kworker.0 Request processed in 33us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.091621:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789136010.091669:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819456 00000100:00100000:0.0:1789136010.091683:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819456 00000100:00100000:0.0:1789136010.091717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666819200 00000100:00100000:0.0:1789136010.091720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666819200 00000100:00100000:0.0:1789136010.091734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789136010.091739:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666819456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.091774:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666819456:12345-0@lo:400:kworker.0 Request processed in 35us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.091780:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789136010.091793:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789136010.091798:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666819200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.091827:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4466940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666819200:12345-0@lo:400:kworker.0 Request processed in 29us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.091832:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789136010.091851:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789136010.091948:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789136010.092140:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666820224:0@lo:400:kworker.0 00000100:00100000:3.0:1789136010.092152:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666819200:0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.092872:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6413840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666818944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136010.092894:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789136010.092938:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6413840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666818944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (4466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136010.093245:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666819840:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.093264:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666820352:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.093280:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666818944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136010.093290:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666819456:0@lo:400:kworker.0 00000100:00100000:1.0:1789136010.093335:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d03852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666818688:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789136010.093405:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136010.093411:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136010.096165:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789136010.099906:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666818816:12345-0@lo:400:kworker.0 Request processed in 8829us (11111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136010.099926:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1789136010.106469:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789136010.321283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136010.321566:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644734976 00000100:00100000:1.0:1789136010.321578:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644734976 00000100:00100000:1.0:1789136010.321786:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:1.0:1789136010.321798:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+19:13434:x1876044644734976:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:1.0:1789136010.322147:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+20:13434:x1876044644734976:12345-192.168.201.31@tcp:35:umount.0 Request processed in 349us (874us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789136010.322155:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00080000:3.0:1789136010.333443:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136010.333945:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136010.335006:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644735232 00000100:00100000:3.0:1789136010.335017:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644735232 00000100:00100000:3.0:1789136010.335097:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1789136010.335108:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+20:13434:x1876044644735232:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:3.0:1789136010.335801:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+21:13434:x1876044644735232:12345-192.168.201.31@tcp:35:umount.0 Request processed in 690us (1857us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789136010.335811:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:0.0:1789136010.345215:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136010.345342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644735488 00000100:00100000:3.0:1789136010.345353:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644735488 00000100:00100000:3.0:1789136010.345641:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:3.0:1789136010.345653:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+21:13434:x1876044644735488:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:3.0:1789136010.346765:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18f2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50163b70-8f7a-42d3-bcbf-652648370aa8+22:13434:x1876044644735488:12345-192.168.201.31@tcp:35:umount.0 Request processed in 1107us (1556us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789136010.346775:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:1.0:1789136010.354251:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136010.354374:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644735744 00000100:00100000:0.0:1789136010.354599:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644735744 00000100:00100000:0.0:1789136010.354776:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1789136010.354788:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+22:13434:x1876044644735744:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:0.0:1789136010.355379:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:13434:x1876044644735744:12345-192.168.201.31@tcp:35:umount.0 Request processed in 592us (1134us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789136010.355415:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:1.0:1789136010.360749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136010.360831:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136010.361131:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644735872 00000100:00100000:0.0:1789136010.361141:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644735872 00000100:00100000:0.0:1789136010.361233:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644736128 00000100:00100000:0.0:1789136010.361237:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644736128 00000100:00100000:3.0:1789136010.361281:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1789136010.361293:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cffc7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+14:2392:x1876044644735872:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136010.361320:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136010.361341:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802044c00/0x559c8745c6de29d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08834 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136010.361357:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136010.361730:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cffc7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+13:2392:x1876044644735872:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 437us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136010.361738:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1789136010.361789:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789136010.361796:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+12:2392:x1876044644736128:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136010.361804:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136010.361814:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f4c00/0x559c8745c6de2d42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08929 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136010.361839:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136010.361891:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f56ac69e-f262-403a-94d3-403db5052814+11:2392:x1876044644736128:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 95us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136010.361898:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:1.0:1789136010.364054:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136010.364156:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644736512 00000100:00100000:2.0:1789136010.364165:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644736512 00000100:00100000:2.0:1789136010.364238:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:2.0:1789136010.364249:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+7:2388:x1876044644736512:12345-192.168.201.31@tcp:9:umount.0 00000020:00000080:2.0:1789136010.364283:0:8536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3083 00000020:00010000:2.0:1789136010.364292:0:8536:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a6c44fc800: total 0 00000100:00080000:2.0:1789136010.364298:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a7d893c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136010.364358:0:8536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:3.0:1789136010.364654:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:3.0:1789136010.364682:0:6503:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a6c44fc800: total 0 00010000:00010000:3.0:1789136010.364734:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a6c44fc800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789136010.364798:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e22535/0x559c8745c6de3b0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cf6 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136010.364832:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c7d66cf/0x559c8745c6de343b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b13 expref: 5 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136010.364846:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a6c44fc800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789136010.364894:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136010.364897:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136010.364899:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136010.365170:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50163b70-8f7a-42d3-bcbf-652648370aa8+2:2388:x1876044644736512:12345-192.168.201.31@tcp:9:umount.0 Request processed in 922us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136010.365179:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:1.0:1789136010.366514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136010.366749:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644736000 00000100:00100000:2.0:1789136010.366757:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644736000 00000100:00100000:2.0:1789136010.366816:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1789136010.366826:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+11:2392:x1876044644736000:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136010.366841:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136010.366887:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879000/0x559c8745c6de2998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab087f5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.366909:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136010.366965:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644736000:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 139us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136010.366990:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:3.0:1789136010.375476:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136010.375728:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644736640 00000100:00100000:0.0:1789136010.375737:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644736640 00000100:00080000:3.0:1789136010.375839:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136010.375899:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:0.0:1789136010.375910:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2388:x1876044644736640:12345-192.168.201.31@tcp:9:umount.0 00000020:00000080:0.0:1789136010.375942:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2e0d 00000100:00080000:0.0:1789136010.375949:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a6c44ba000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136010.375986:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789136010.376162:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:50163b70-8f7a-42d3-bcbf-652648370aa8+2:2388:x1876044644736640:12345-192.168.201.31@tcp:9:umount.0 Request processed in 254us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.376168:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00010000:00010000:2.0:1789136010.376215:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136010.386478:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136010.386635:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644737664 00000100:00100000:0.0:1789136010.386646:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644737664 00000100:00100000:0.0:1789136010.386703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 258 00000100:00100000:0.0:1789136010.386714:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+23:2388:x1876044644737664:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:0.0:1789136010.386750:0:6516:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de29a6 00000020:00010000:0.0:1789136010.386766:0:6516:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7ff553800: total 0 00000100:00080000:0.0:1789136010.386771:0:6516:0:(import.c:65:import_set_state_nolock()) ffff90a6c2df3800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136010.386805:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:2.0:1789136010.386877:0:13980:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7ff553800: total 0 00010000:00010000:2.0:1789136010.386933:0:13980:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7ff553800, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1789136010.386968:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:2.0:1789136010.386971:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1789136010.386977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50163b70-8f7a-42d3-bcbf-652648370aa8+22:2388:x1876044644737664:12345-192.168.201.31@tcp:39:umount.0 Request processed in 265us (512us total) trans 4294967527 rc 0/0 00010000:00010000:2.0:1789136010.386978:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de30de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08a2c expref: 22 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136010.386985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 258 00010000:00010000:2.0:1789136010.386996:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789136010.386999:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789136010.387003:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de39eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ca9 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387030:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:2.0:1789136010.387032:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789136010.387036:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de331c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ac6 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387050:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:2.0:1789136010.387053:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136010.387057:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de3418 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b05 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387070:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7fa59fb00) 00010000:00010000:2.0:1789136010.387072:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136010.387076:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de2d6c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08937 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387120:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789136010.387123:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789136010.387127:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de34c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b36 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387140:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789136010.387143:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789136010.387146:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de3af5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cef expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387158:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90a6c2b0f400) 00010000:00010000:2.0:1789136010.387160:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789136010.387163:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de2de3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08953 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387179:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90a7e0aa7500) 00010000:00010000:2.0:1789136010.387181:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789136010.387185:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e800/0x559c8745c6de37ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08c0f expref: 13 pid: 14529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387198:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90a7fa5a1e00) 00010000:00010000:2.0:1789136010.387200:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136010.387204:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de3acb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ce1 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387218:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:2.0:1789136010.387220:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136010.387232:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878000/0x559c8745c6de34a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b2f expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387245:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a6c2b0f500) 00010000:00010000:2.0:1789136010.387247:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136010.387250:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de2d88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0893e expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387264:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:2.0:1789136010.387266:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789136010.387270:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3e200/0x559c8745c6de33ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08afe expref: 9 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387280:0:13980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90a7e0aa7e00) 00010000:00010000:2.0:1789136010.387282:0:13980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789136010.387286:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3f200/0x559c8745c6de3426 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08b0c expref: 8 pid: 14528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136010.387298:0:13980:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7ff553800, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1789136010.387327:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136010.387329:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136010.387331:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136010.404443:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136010.404673:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644737792 00000100:00100000:2.0:1789136010.404683:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644737792 00000100:00100000:2.0:1789136010.404773:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 259 00000100:00100000:2.0:1789136010.404783:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+5:2388:x1876044644737792:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:2.0:1789136010.404819:0:14529:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de29ad 00000100:00080000:2.0:1789136010.404837:0:14529:0:(import.c:65:import_set_state_nolock()) ffff90a7ff592000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136010.405177:0:14529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789136010.405380:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:50163b70-8f7a-42d3-bcbf-652648370aa8+3:2388:x1876044644737792:12345-192.168.201.31@tcp:39:umount.0 Request processed in 596us (953us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789136010.405389:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 259 00000100:00080000:3.0:1789136010.406222:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789136010.406555:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136010.477421:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136010.600577:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136010.600666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136010.600750:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820480 00000100:00100000:0.0:1789136010.600771:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820480 00000100:00100000:0.0:1789136010.600826:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789136010.600837:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666820480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136010.600897:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789136010.600948:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666820480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136010.600955:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789136010.601001:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136010.602011:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666820608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136010.602066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136010.602169:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820608 00000100:00100000:1.0:1789136010.602175:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820608 00000100:00100000:1.0:1789136010.602216:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789136010.602225:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666820608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136010.602240:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789136010.602291:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666820608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136010.602329:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789136010.602370:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666820608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136011.112910:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136011.112936:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666820736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136011.113010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136011.113282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820736 00000100:00100000:0.0:1789136011.113323:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820736 00000100:00100000:0.0:1789136011.113393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789136011.113404:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666820736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136011.113438:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789136011.113497:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666820736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136011.113503:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789136011.113594:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666820736:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789136011.500639:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136011.763805:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136011.763887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136011.763925:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136011.764088:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644737920 00000100:00100000:0.0:1789136011.764098:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644737920 00000100:00100000:0.0:1789136011.764161:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 475 00000100:00100000:0.0:1789136011.764172:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644737920:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136011.764245:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f56ac69e-f262-403a-94d3-403db5052814+10:2391:x1876044644737920:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 74us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136011.764254:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 475 00000100:00100000:3.0:1789136011.767141:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738176 00000100:00100000:3.0:1789136011.767156:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738176 00000100:00100000:3.0:1789136011.767298:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738048 00000100:00100000:3.0:1789136011.767303:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738048 00000100:00100000:2.0:1789136011.767371:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 447 00000100:00100000:2.0:1789136011.767383:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644738176:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136011.767481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2391:x1876044644738176:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 99us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136011.767488:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 447 00000100:00080000:1.0:1789136011.773474:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136011.773485:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136011.775209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 448 00000100:00100000:3.0:1789136011.775238:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644738048:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136011.775339:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2391:x1876044644738048:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 107us (11413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136011.775347:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 448 00010000:00010000:1.0:1789136012.520327:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136013.096102:0:14496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789136013.096113:0:14496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136013.096193:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789136013.096201:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789136013.255999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136013.256058:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136013.256224:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738304 00000100:00100000:2.0:1789136013.256233:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738304 00000100:00100000:2.0:1789136013.256327:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738560 00000100:00100000:2.0:1789136013.256330:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738560 00000100:00100000:2.0:1789136013.256358:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136013.256367:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+11:2392:x1876044644738304:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136013.256384:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136013.256404:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de2aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08849 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136013.256423:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136013.256508:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789136013.256518:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644738560:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136013.256527:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136013.256537:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f600/0x559c8745c6de2d3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08922 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136013.256548:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136013.256581:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136013.257239:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738432 00000100:00100000:1.0:1789136013.257245:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738432 00000100:00100000:1.0:1789136013.257292:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:1.0:1789136013.257298:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f56ac69e-f262-403a-94d3-403db5052814+10:2392:x1876044644738432:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136013.257307:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136013.257318:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94c800/0x559c8745c6de2ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0887a expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136013.257328:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136013.259283:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f56ac69e-f262-403a-94d3-403db5052814+9:2392:x1876044644738304:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 2905us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136013.259297:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1789136013.264721:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f56ac69e-f262-403a-94d3-403db5052814+8:2392:x1876044644738560:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 8191us (8649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136013.264737:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1789136013.268586:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136013.268785:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738816 00000100:00100000:0.0:1789136013.268795:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738816 00000100:00100000:0.0:1789136013.268903:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 260 00000100:00100000:0.0:1789136013.268914:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+6:2388:x1876044644738816:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:0.0:1789136013.268953:0:14528:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2abe 00000020:00010000:0.0:1789136013.268961:0:14528:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7ff5c5800: total 0 00000100:00080000:0.0:1789136013.268966:0:14528:0:(import.c:65:import_set_state_nolock()) ffff90a7ff5c6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136013.268991:0:14528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789136013.269185:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2388:x1876044644738816:12345-192.168.201.31@tcp:39:umount.0 Request processed in 273us (610us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789136013.269193:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 260 00000020:00010000:0.0:1789136013.269219:0:6504:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7ff5c5800: total 0 00010000:00010000:0.0:1789136013.269222:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136013.269292:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7ff5c5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789136013.269333:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7e0aa7f00) 00010000:00010000:0.0:1789136013.269337:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136013.269346:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c2d3ea00/0x559c8745c6de3b18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08cfd expref: 4 pid: 8299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136013.269373:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7ff5c5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789136013.269385:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136013.269387:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136013.269388:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136013.270323:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136013.274670:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f56ac69e-f262-403a-94d3-403db5052814+7:2392:x1876044644738432:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 17356us (18074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136013.274687:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1789136013.290844:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136013.290998:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644738944 00000100:00100000:0.0:1789136013.291009:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644738944 00000100:00100000:0.0:1789136013.291094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 261 00000100:00100000:0.0:1789136013.291115:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+5:2388:x1876044644738944:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:0.0:1789136013.291174:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2ac5 00000100:00080000:0.0:1789136013.291184:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90a7ff5c4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136013.291217:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789136013.291386:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8cf048c-d8c6-435a-a255-87c185db70f0+3:2388:x1876044644738944:12345-192.168.201.31@tcp:39:umount.0 Request processed in 274us (555us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789136013.291395:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 261 00010000:00010000:1.0:1789136013.291968:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136013.292034:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136013.326899:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136013.328630:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739200 00000100:00100000:2.0:1789136013.328643:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739200 00000100:00100000:2.0:1789136013.328721:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 476 00000100:00100000:2.0:1789136013.328731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+7:2388:x1876044644739200:12345-192.168.201.31@tcp:251:umount.0 00000020:00000080:2.0:1789136013.328778:0:6509:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2983 00000020:00010000:2.0:1789136013.328785:0:6509:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7ff556000: total 0 00000100:00080000:2.0:1789136013.328790:0:6509:0:(import.c:65:import_set_state_nolock()) ffff90a7ff551000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789136013.328908:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f56ac69e-f262-403a-94d3-403db5052814+3:2388:x1876044644739200:12345-192.168.201.31@tcp:251:umount.0 Request processed in 178us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136013.328916:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 476 00000020:00010000:1.0:1789136013.329367:0:6503:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7ff556000: total 0 00010000:00010000:1.0:1789136013.329433:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7ff556000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789136013.329471:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802045400/0x559c8745c6de29de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0883b expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136013.329500:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7ff556000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789136013.329513:0:6503:0:(genops.c:885:class_export_put()) final put ffff90a7ff556000/f56ac69e-f262-403a-94d3-403db5052814 00010000:00010000:1.0:1789136013.329531:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136013.329553:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136013.329554:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789136013.329740:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff556000/f56ac69e-f262-403a-94d3-403db5052814 for MGS 00000020:00000080:0.0:1789136013.329783:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff551000 for MGS 00010000:00010000:0.0:1789136013.544329:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136013.674502:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136014.576260:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136014.696877:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136014.696900:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4464b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666820864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136014.696974:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136014.697052:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820864 00000100:00100000:1.0:1789136014.697060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820864 00000100:00100000:1.0:1789136014.697127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789136014.697138:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666820864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136014.697173:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789136014.697241:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666820864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136014.697248:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789136014.697338:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4464b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666820864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136015.208114:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136015.208141:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666820992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136015.208230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.208406:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666821120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136015.208437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136015.208591:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666820992 00000100:00100000:1.0:1789136015.208599:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666820992 00000100:00100000:1.0:1789136015.209424:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821120 00000100:00100000:1.0:1789136015.209430:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821120 00000100:00080000:3.0:1789136015.210471:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136015.210625:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136015.210802:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789136015.210814:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666820992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136015.210874:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789136015.210943:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666820992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (2713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136015.210950:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789136015.210968:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789136015.210974:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666821120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789136015.210983:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789136015.211066:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666821376:0@lo:400:kworker.0 00000100:00100000:2.0:1789136015.211106:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136015.211168:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666820992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136015.211190:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136015.211195:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666821504:0@lo:400:kworker.0 00000100:00100000:2.0:1789136015.211233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136015.211287:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821376 00000100:00100000:2.0:1789136015.211293:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821376 00000100:00100000:2.0:1789136015.211340:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1789136015.211347:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666821376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136015.211386:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666821376:12345-0@lo:400:kworker.0 Request processed in 41us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136015.211393:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1789136015.211424:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666821376:0@lo:400:kworker.0 00000100:00100000:2.0:1789136015.211449:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821504 00000100:00100000:2.0:1789136015.211452:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821504 00000100:00100000:2.0:1789136015.211479:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789136015.211485:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666821504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136015.211522:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666821504:12345-0@lo:400:kworker.0 Request processed in 37us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136015.211528:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789136015.211552:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666821504:0@lo:400:kworker.0 00000100:00100000:3.0:1789136015.211775:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666821632:0@lo:400:kworker.0 00000100:00100000:3.0:1789136015.215864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136015.215945:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666821248:0@lo:400:kworker.0 00000100:00100000:3.0:1789136015.216008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216311:0:8299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821632 00000100:00100000:0.0:1789136015.216319:0:8299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821632 00000100:00100000:0.0:1789136015.216368:0:8299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1789136015.216376:0:8299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666821632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216427:0:8299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666821632:12345-0@lo:400:kworker.0 Request processed in 52us (4615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.216434:0:8299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1789136015.216463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666821760:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216489:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216508:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666822272:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216545:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216567:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136015.216572:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666822144:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216615:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666821888:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216648:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666822400:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216683:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789136015.216687:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666822016:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216713:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666822528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.216730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.216750:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822272 00000100:00100000:0.0:1789136015.216753:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822272 00000100:00100000:0.0:1789136015.216777:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822144 00000100:00100000:0.0:1789136015.216779:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822144 00000100:00100000:0.0:1789136015.216789:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821888 00000100:00100000:0.0:1789136015.216791:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821888 00000100:00100000:0.0:1789136015.216801:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822016 00000100:00100000:0.0:1789136015.216803:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822016 00000100:00100000:0.0:1789136015.216973:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789136015.216982:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666822272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217016:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666822272:12345-0@lo:400:kworker.0 Request processed in 35us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217021:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789136015.217036:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1789136015.217048:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666822144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217074:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666822144:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217079:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1789136015.217091:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789136015.217096:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666821888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217123:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666821888:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217129:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789136015.217139:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789136015.217144:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666822016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217164:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666822016:12345-0@lo:400:kworker.0 Request processed in 20us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217169:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789136015.217186:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821760 00000100:00100000:0.0:1789136015.217189:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821760 00000100:00100000:0.0:1789136015.217211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789136015.217230:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666821760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217255:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666821760:12345-0@lo:400:kworker.0 Request processed in 27us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789136015.217341:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822400 00000100:00100000:0.0:1789136015.217345:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822400 00000100:00100000:0.0:1789136015.217367:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822528 00000100:00100000:0.0:1789136015.217370:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822528 00000100:00100000:0.0:1789136015.217387:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789136015.217394:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666822400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217430:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666822400:12345-0@lo:400:kworker.0 Request processed in 37us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217436:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789136015.217447:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789136015.217453:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666822528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217475:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666822528:12345-0@lo:400:kworker.0 Request processed in 23us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.217480:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1789136015.217497:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789136015.217502:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136015.217504:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136015.217530:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666822144:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217540:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666821760:0@lo:400:kworker.0 00010000:00080000:0.0:1789136015.217550:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c96d1a40 x1876044666822272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136015.217559:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666822272:0@lo:400:kworker.0 00010000:00080000:0.0:1789136015.217593:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c96d0b40 x1876044666822016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136015.217602:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666822016:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217610:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666822528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666821888:0@lo:400:kworker.0 00000100:00100000:0.0:1789136015.217625:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666822400:0@lo:400:kworker.0 00000100:00100000:1.0:1789136015.217765:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666821120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6789us (9325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136015.217780:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789136015.217806:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666821248 00000100:00100000:1.0:1789136015.217810:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666821248 00000100:00100000:1.0:1789136015.217850:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789136015.217877:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666821248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136015.217911:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3640:x1876044666821248:12345-0@lo:400:kworker.0 Request processed in 36us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136015.217917:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1789136015.220981:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c2fe2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666821120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136015.221031:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666821632:0@lo:400:kworker.0 00000100:00100000:3.0:1789136015.221054:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666821248:0@lo:400:kworker.0 00000020:01000004:1.0:1789136015.252799:0:15763:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789136015.282445:0:15763:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789136015.282506:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.282524:0:15763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.282533:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.282541:0:15763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.282567:0:15763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789136015.282587:0:15763:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789136015.282611:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136015.282615:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789136015.282620:0:15763:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789136015.282645:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a7fa558000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789136015.283539:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136015.283550:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136015.283561:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136015.283565:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136015.283574:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136015.283581:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136015.283586:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136015.283589:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789136015.283591:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789136015.283625:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136015.283645:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136015.283680:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136015.283687:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de2a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a40 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136015.283702:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136015.283704:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136015.283706:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136015.283715:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136015.283735:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666822784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136015.283802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136015.283894:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822784 00000100:00100000:1.0:1789136015.283901:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822784 00000100:00100000:1.0:1789136015.283953:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136015.283963:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3641:x1876044666822784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136015.283978:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136015.283993:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de2a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a39 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136015.284008:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136015.284044:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3641:x1876044666822784:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136015.284051:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789136015.284387:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666822656:0@lo:39:umount.0 00000100:00100000:0.0:1789136015.284427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136015.284463:0:14529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822656 00000100:00100000:0.0:1789136015.284467:0:14529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822656 00000100:00100000:0.0:1789136015.284497:0:14529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789136015.284503:0:14529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876044666822656:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789136015.284528:0:14529:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de259a 00000100:00080000:0.0:1789136015.284537:0:14529:0:(import.c:65:import_set_state_nolock()) ffff90a7ce87c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789136015.284586:0:14529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1876044666822656:12345-0@lo:39:umount.0 Request processed in 83us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136015.284592:0:14529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1789136015.284599:0:14529:0:(genops.c:885:class_export_put()) final put ffff90a7ce879000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789136015.284619:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136015.284640:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa558000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789136015.284648:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666822656:0@lo:39:umount.0 00000020:00000080:0.0:1789136015.284668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ce879000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789136015.284704:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ce87c000 for lustre-MDT0000 00000100:00080000:2.0:1789136015.285117:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136015.285121:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789136015.285126:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789136015.286156:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286171:0:15763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286179:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286186:0:15763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286828:0:15763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136015.286838:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286845:0:15763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286875:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286900:0:15763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286918:0:15763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136015.286926:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286932:0:15763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286938:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286944:0:15763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286953:0:15763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789136015.286958:0:15763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286965:0:15763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286970:0:15763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286976:0:15763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136015.286993:0:15763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789136015.286996:0:15763:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789136015.287026:0:15763:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789136015.287031:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789136015.287035:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136015.287040:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789136015.287047:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a6c3a2e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136015.287052:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a6c228e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136015.287057:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a7fa413000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136015.287062:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a7e764c000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789136015.287069:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90a7ff5c5800 f8cf048c-d8c6-435a-a255-87c185db70f0 192.168.201.31@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136015.287074:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90a7ff553800 50163b70-8f7a-42d3-bcbf-652648370aa8 192.168.201.31@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1789136015.287078:0:15763:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90a7f0940000) has exports, disconnecting them 00000020:00080000:2.0:1789136015.287083:0:15763:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a6c3a2e800), last request at 1789136015 00000020:00000080:2.0:1789136015.287089:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de28aa 00000100:00080000:2.0:1789136015.287105:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789136015.287203:0:15763:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c3a2e800): rc 0 00000020:00000080:2.0:1789136015.287206:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789136015.287225:0:15763:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a6c228e800), last request at 1789136015 00000020:00000080:2.0:1789136015.287229:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2784 00000100:00080000:2.0:1789136015.287235:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789136015.287241:0:15763:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c228e800): rc 0 00000020:00000080:2.0:1789136015.287243:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a6c228e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789136015.287247:0:15763:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a7fa413000), last request at 1789135738 00000020:00000080:2.0:1789136015.287250:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2681 00000100:00080000:2.0:1789136015.287259:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a7fa414800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789136015.289418:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789136015.289430:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289441:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ef94d400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136015.289445:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289455:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136015.289463:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136015.289468:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136015.289471:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789136015.289474:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789136015.289522:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289529:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136015.289550:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289557:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ef94d400/0x559c8745c6de2a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a4e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289570:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136015.289574:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289592:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136015.289596:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289603:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136015.289609:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136015.289614:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136015.289616:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789136015.289618:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789136015.289633:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289639:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136015.289656:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289663:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de293d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2944 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289673:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136015.289677:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289683:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136015.289686:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289699:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136015.289705:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136015.289711:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789136015.289713:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789136015.289715:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789136015.289727:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289732:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136015.289737:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289744:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031400/0x559c8745c6de2d2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2d34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289753:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136015.289757:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289762:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dcc00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136015.289765:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289771:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136015.289785:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136015.289791:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136015.289793:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789136015.289794:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789136015.289804:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289809:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136015.289814:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289820:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a8021dcc00/0x559c8745c6de24f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2500 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.289830:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136015.289832:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136015.289834:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136015.289874:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4465680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666823040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.289961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136015.290016:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136015.290023:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666823168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.290046:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136015.290076:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823040 00000100:00100000:3.0:1789136015.290083:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823040 00000100:00100000:3.0:1789136015.290126:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823168 00000100:00100000:3.0:1789136015.290129:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823168 00000100:00100000:3.0:1789136015.290152:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136015.290169:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cffc7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+24:3638:x1876044666823040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136015.290182:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136015.290197:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de2944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de293d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.290223:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136015.290262:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cffc7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+23:3638:x1876044666823040:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136015.290280:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136015.290323:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136015.290329:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4464b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+22:3638:x1876044666823168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136015.290335:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136015.290345:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de2d34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2d2d expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.290354:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136015.290374:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4464b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3638:x1876044666823168:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136015.290380:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136015.290416:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666823168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.290425:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4465680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:44af6ea5-156e-4935-ba38-1972bb1ada25:3638:1876044666823040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.290465:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666823296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.290487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136015.290505:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823296 00000100:00100000:3.0:1789136015.290508:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823296 00000100:00100000:3.0:1789136015.290530:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136015.290545:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+21:3640:x1876044666823296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136015.290554:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136015.290563:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f800/0x559c8745c6de2500 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de24f9 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.290575:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136015.290598:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4465680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3640:x1876044666823296:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136015.290604:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136015.290628:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4466580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666823296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.290640:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136015.290646:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666822912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136015.290667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136015.290685:0:13680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666822912 00000100:00100000:3.0:1789136015.290688:0:13680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666822912 00000100:00100000:3.0:1789136015.290710:0:13680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136015.290717:0:13680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4466580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+20:3640:x1876044666822912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136015.290724:0:13680:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136015.290733:0:13680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ef94c200/0x559c8745c6de2a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a47 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136015.290743:0:13680:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136015.290765:0:13680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4466580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:44af6ea5-156e-4935-ba38-1972bb1ada25+19:3640:x1876044666822912:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136015.290772:0:13680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789136015.290795:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666822912:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789136015.291097:0:15763:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7fa413000): rc 0 00000020:00000080:2.0:1789136015.291100:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7fa413000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789136015.291109:0:15763:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a7e764c000), last request at 1789135737 00000020:00000080:2.0:1789136015.291117:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2642 00000100:00080000:2.0:1789136015.291124:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a7e7648800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136015.291147:0:15763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1789136015.291242:0:15763:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7e764c000): rc 0 00000004:00000080:2.0:1789136015.291248:0:15763:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb1d485dfae0 00010000:00010000:0.0:1789136015.291377:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789136015.291389:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789136015.291431:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c228e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789136015.291451:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa413000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789136015.291474:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3a2c000 for lustre-MDT0000 00000020:00000080:0.0:1789136015.291479:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c228c800 for lustre-MDT0000 00000020:00000080:0.0:1789136015.291482:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa414800 for lustre-MDT0000 00000100:00080000:2.0:1789136015.291527:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789136015.291531:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1789136015.292429:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136015.293582:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666822784:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789136015.295522:0:15763:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789136015.295566:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a7fa55c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789136015.296255:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666823424:0@lo:39:umount.0 00000100:00100000:3.0:1789136015.296350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789136015.296561:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136015.297914:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823424 00000100:00100000:2.0:1789136015.297927:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823424 00000100:00100000:2.0:1789136015.297984:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789136015.297995:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1876044666823424:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789136015.298032:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de26dc 00000100:00080000:2.0:1789136015.298040:0:6521:0:(import.c:65:import_set_state_nolock()) ffff90a7f0936000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136015.298059:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1789136015.298453:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136015.298596:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3637:x1876044666823424:12345-0@lo:39:umount.0 Request processed in 602us (2244us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789136015.298604:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1789136015.298676:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789136015.298681:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789136015.298701:0:15763:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789136015.298761:0:15763:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789136015.298782:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789136015.298808:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789136015.298810:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1789136015.298823:0:15763:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789136015.298912:0:15763:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789136015.298923:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a6c3dd5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789136015.298955:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a7f0940000) has no exports 00000100:00080000:3.0:1789136015.299803:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa55c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789136015.299814:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666823424:0@lo:39:umount.0 00000100:00100000:2.0:1789136015.299975:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666823552:0@lo:9:umount.0 00000100:00100000:2.0:1789136015.300034:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136015.300112:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666823680:0@lo:9:umount.0 00000100:00100000:2.0:1789136015.300136:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136015.300432:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823552 00000100:00100000:1.0:1789136015.300439:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823552 00000100:00100000:1.0:1789136015.300501:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823680 00000100:00100000:1.0:1789136015.300504:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823680 00000100:00100000:1.0:1789136015.300527:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789136015.300537:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876044666823552:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789136015.300565:0:8536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de282c 00000100:00080000:1.0:1789136015.300574:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a7ff503800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136015.300616:0:8536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789136015.300745:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1876044666823552:12345-0@lo:9:umount.0 Request processed in 209us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136015.300754:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789136015.300772:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789136015.300779:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1876044666823680:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789136015.300790:0:8536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de296e 00000100:00080000:1.0:1789136015.300795:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136015.300817:0:8536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789136015.300917:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3637:x1876044666823680:12345-0@lo:9:umount.0 Request processed in 138us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136015.300923:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1789136015.300943:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136015.300962:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789136015.300972:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789136015.300974:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136015.300977:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666823552:0@lo:9:umount.0 00000100:00080000:1.0:1789136015.300986:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3dd5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789136015.300994:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789136015.300995:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136015.300998:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666823680:0@lo:9:umount.0 00010000:00010000:2.0:1789136015.301108:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789136015.305192:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a7f0940000) has no exports 00000020:00000080:2.0:1789136015.361375:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2554 00000020:00000080:2.0:1789136015.361391:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7fa416800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789136015.361412:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789136015.361740:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa416800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789136015.361769:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136015.361778:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789136015.361796:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90a7efa1b490) has no exports 00000020:00000080:0.0:1789136015.362452:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de254d 00000020:00000080:0.0:1789136015.362460:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f08fe800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136015.362520:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136015.362527:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789136015.362530:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f08f8800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789136015.362533:0:15763:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f08f8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789136015.362538:0:15763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789136015.362763:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f08fe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1789136015.602897:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136015.722266:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136015.722290:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666823808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136015.722366:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136015.722881:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823808 00000100:00100000:2.0:1789136015.722890:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823808 00000100:00100000:2.0:1789136015.722941:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789136015.722950:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4467c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666823808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136015.722981:0:10096:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789136015.723219:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4467c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666823808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 269us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136015.723227:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789136015.723734:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666823808:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1789136015.726354:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789136015.726368:0:8425:0:(genops.c:885:class_export_put()) final put ffff90a7ff501000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789136015.726561:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789136015.726574:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789136015.726579:0:7447:0:(genops.c:885:class_export_put()) final put ffff90a7f0935800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789136015.726585:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00080000:0.0:1789136015.726592:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789136015.726594:0:7447:0:(genops.c:885:class_export_put()) final put ffff90a7ff5c2000/f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00100000:0.0:1789136015.726600:0:7447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000001:00080000:0.0:1789136015.726603:0:7447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789136015.726605:0:7447:0:(genops.c:885:class_export_put()) final put ffff90a6c2df7000/50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:0.0:1789136015.726626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff501000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789136015.726672:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0935800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789136015.726702:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5c2000/f8cf048c-d8c6-435a-a255-87c185db70f0 for lustre-MDT0001 00000020:00000080:0.0:1789136015.726726:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2df7000/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-MDT0001 00000020:00000080:0.0:1789136015.726749:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff503800 for lustre-OST0000 00000020:00000080:0.0:1789136015.726753:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7f0936000 for lustre-MDT0001 00000020:00000080:0.0:1789136015.726756:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff5c4800 for lustre-MDT0001 00000020:00000080:0.0:1789136015.726760:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff592000 for lustre-MDT0001 00000001:00100000:1.0:1789136015.727175:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136015.727195:0:9511:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789136015.727225:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:1.0:1789136015.727227:0:9511:0:(genops.c:885:class_export_put()) final put ffff90a6c44fc800/50163b70-8f7a-42d3-bcbf-652648370aa8 00000001:00100000:2.0:1789136015.727298:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:2.0:1789136015.727308:0:8425:0:(genops.c:885:class_export_put()) final put ffff90a6c44bf800/50163b70-8f7a-42d3-bcbf-652648370aa8 00000001:00100000:3.0:1789136015.727411:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789136015.727415:0:6494:0:(genops.c:885:class_export_put()) final put ffff90a7e764c000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789136015.727422:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00080000:3.0:1789136015.727427:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1789136015.727430:0:6494:0:(genops.c:885:class_export_put()) final put ffff90a7ff5c5800/f8cf048c-d8c6-435a-a255-87c185db70f0 00000001:00100000:3.0:1789136015.727436:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 50163b70-8f7a-42d3-bcbf-652648370aa8 00000001:00080000:3.0:1789136015.727644:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1789136015.727654:0:6494:0:(genops.c:885:class_export_put()) final put ffff90a7ff553800/50163b70-8f7a-42d3-bcbf-652648370aa8 00000020:00000080:0.0:1789136015.731309:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789136015.731376:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c44fc800/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-OST0001 00000020:00000080:0.0:1789136015.731401:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c44bf800/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-OST0000 00000020:00000080:0.0:1789136015.731502:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e764c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789136015.731584:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5c5800/f8cf048c-d8c6-435a-a255-87c185db70f0 for lustre-MDT0000 00000020:00000080:0.0:1789136015.731620:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff553800/50163b70-8f7a-42d3-bcbf-652648370aa8 for lustre-MDT0000 00000020:00000080:0.0:1789136015.731647:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3a2a000 for lustre-OST0001 00000020:00000080:0.0:1789136015.731652:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7d893c000 for lustre-OST0001 00000020:00000080:0.0:1789136015.731655:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c44ba000 for lustre-OST0000 00000020:00000080:0.0:1789136015.731660:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7e7648800 for lustre-MDT0000 00000020:00000080:0.0:1789136015.731664:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff5c6000 for lustre-MDT0000 00000020:00000080:0.0:1789136015.731667:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2df3800 for lustre-MDT0000 00010000:00010000:1.0:1789136016.616525:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789136017.384000:0:15763:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7f64e3e40 - data ffff90a7cef21ca8/ffff90a7fa731000 00000020:01000000:0.0:1789136017.384143:0:15763:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7cea81a80 - data ffff90a7ced586c0/ffff90a7f04cd800 00000001:00000004:0.0:1789136017.389772:0:15763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789136017.483231:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789136017.483240:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789136017.483252:0:15763:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90a6c3d92940 x1876044666823424/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789136025 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136017.483276:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789136017.486961:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136017.486969:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1789136017.487039:0:15763:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136017.487057:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136017.487566:0:8534:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136017.487573:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789136017.487584:0:8534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789136017.488831:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136017.488837:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789136017.489019:0:15763:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136017.489023:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136017.489306:0:9963:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136017.489311:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789136017.489320:0:9963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789136017.490774:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de251c 00000020:00000080:3.0:1789136017.490785:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0932800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136017.493268:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0932800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789136017.493957:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2531 00000020:00000080:3.0:1789136017.493967:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0960000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789136017.494012:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789136017.494019:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136017.494027:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789136017.494031:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90a7f0941a48) has no exports 00000004:01000000:3.0:1789136017.494209:0:15763:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789136017.494218:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2967 00000020:00000080:3.0:1789136017.494223:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136017.494258:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0960000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789136017.494495:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789136017.494501:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136017.494510:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136017.494513:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff90a6c2b90000) has no exports 00000020:00000080:3.0:1789136017.494520:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2960 00000020:00000080:3.0:1789136017.494525:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a6c3dd4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136017.494543:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1789136017.494987:0:15763:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789136017.494993:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136017.494997:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789136017.495003:0:15763:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136017.495006:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136017.495046:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3dd4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789136017.495129:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136017.495139:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136017.495145:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2825 00000020:00000080:3.0:1789136017.495151:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7ff551800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136017.495170:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3dd5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789136017.495188:0:38:0:(genops.c:885:class_export_put()) final put ffff90a6c2e99800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136017.495191:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2e99800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789136017.495196:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789136017.495382:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789136017.495540:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136017.495558:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136017.495562:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90a7f64b3490) has no exports 00000020:00000080:3.0:1789136017.495568:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de281e 00000020:00000080:3.0:1789136017.495573:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a6c228a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136017.495933:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff551800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789136017.495941:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c228a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789136017.496039:0:15763:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789136017.496044:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136017.496047:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789136017.496050:0:15763:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136017.496052:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136017.496122:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136017.496129:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789136017.496139:0:15763:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789136017.496145:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de26d5 00000020:00000080:3.0:1789136017.496150:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f643d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136017.496206:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c228c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789136017.496212:0:38:0:(genops.c:885:class_export_put()) final put ffff90a6c228a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136017.496214:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c228a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789136017.496218:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789136017.496395:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789136017.496399:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136017.496406:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136017.496732:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90a7f64b0000) has no exports 00000020:00000080:3.0:1789136017.496739:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de26ce 00000020:00000080:3.0:1789136017.496744:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0962800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136017.496761:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f643d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789136017.501456:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0962800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789136017.505911:0:15763:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789136017.505921:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136017.505927:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789136017.505936:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136017.506007:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136017.506022:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136017.506052:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136017.506055:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136017.506061:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0937800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136017.506065:0:15763:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0937800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789136017.506072:0:15763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136017.506193:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa55c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789136017.506200:0:38:0:(genops.c:885:class_export_put()) final put ffff90a7f6295800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136017.506202:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6295800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789136017.506210:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136017.506354:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2538 00000020:00000080:0.0:1789136017.506381:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0965000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789136017.506399:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789136017.506404:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136017.506416:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136017.506421:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90a7f0943490) has no exports 00000020:00000080:0.0:1789136017.506440:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136017.506444:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789136017.506449:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de253f 00000020:00000080:0.0:1789136017.506453:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0961800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789136017.506462:0:15763:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7d26b4800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789136017.506465:0:15763:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d26b4800 3 00000020:00000080:1.0:1789136017.506486:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0965000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789136017.506490:0:38:0:(genops.c:885:class_export_put()) final put ffff90a7f0934800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789136017.506491:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0934800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789136017.506495:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789136017.506524:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0961800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789136017.506595:0:15763:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7d26b4800 from lustre-MDT0000 00000020:00000080:0.0:1789136017.506624:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136017.506628:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789136017.506632:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7f0933000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789136017.506634:0:15763:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0933000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789136017.506641:0:15763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789136017.506711:0:15763:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789136017.506715:0:15763:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789136017.506717:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789136017.506720:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136017.506723:0:15763:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136017.506730:0:15763:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90a7c2b68000 44af6ea5-156e-4935-ba38-1972bb1ada25 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136017.506735:0:15763:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90a7e6e98000) has exports, disconnecting them 00000020:00080000:0.0:1789136017.506739:0:15763:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90a7c2b68000), last request at 1789135718 00000020:00000080:0.0:1789136017.506754:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de24dd 00000020:00010000:0.0:1789136017.506758:0:15763:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7c2b68000: total 0 00000100:00080000:0.0:1789136017.506761:0:15763:0:(import.c:65:import_set_state_nolock()) ffff90a7cffbc800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136017.506781:0:15763:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7c2b68000): rc 0 00000020:00080000:0.0:1789136017.506784:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90a7e6e98000) has no exports 00000100:00100000:0.0:1789136017.506833:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90a7d8804800:6510] 2 exiting: rc = 0 00000020:00010000:1.0:1789136017.507009:0:6503:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7c2b68000: total 0 00010000:00010000:1.0:1789136017.507034:0:6503:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7c2b68000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789136017.507063:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de2a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a55 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507078:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879800/0x559c8745c6de2d0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2d03 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507087:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dde00/0x559c8745c6de28fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de28f7 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507100:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167d600/0x559c8745c6de29ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de29e5 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507108:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de2d18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2d11 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507129:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de29fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de29f3 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507138:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de2d26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2d1f expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507149:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a802044400/0x559c8745c6de2a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a01 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507158:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de2a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a0f expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507166:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167d000/0x559c8745c6de2a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a2b expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507185:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a8021dd800/0x559c8745c6de25e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de25e0 expref: 4 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507196:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167d800/0x559c8745c6de2a24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de2a1d expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507206:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030200/0x559c8745c6de25d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de25d2 expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136017.507216:0:6503:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7c2b68000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789136017.507228:0:6503:0:(genops.c:885:class_export_put()) final put ffff90a7c2b68000/44af6ea5-156e-4935-ba38-1972bb1ada25 00010000:00010000:1.0:1789136017.507243:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136017.507245:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136017.507246:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136017.507281:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90a7d8804200:6508] 0 exiting: rc = 1 00000100:00100000:1.0:1789136017.507331:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90a7d8805c00:6509] 1 exiting: rc = 0 00000020:00000080:0.0:1789136017.507563:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c2b68000/44af6ea5-156e-4935-ba38-1972bb1ada25 for MGS 00000020:00000080:0.0:1789136017.507600:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7cffbc800 for MGS 00000100:00100000:0.0:1789136017.507674:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507682:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507687:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507692:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507697:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507703:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507708:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507713:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507718:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507723:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507728:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507740:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507745:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507751:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507757:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507763:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507767:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507773:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507778:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507783:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507789:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507794:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507799:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507804:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507810:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507815:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507820:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507825:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507831:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507836:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507842:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507846:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507870:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507877:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507882:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507889:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507893:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507898:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507904:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507909:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507914:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507920:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507925:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507929:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507934:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507939:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507952:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507958:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507963:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507970:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507975:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507981:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507986:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507990:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.507995:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508000:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508005:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508009:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508014:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508019:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508025:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508029:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508034:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136017.508039:0:15763:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789136017.509030:0:15763:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7f64e37e0 - data ffff90a7cef29948/ffff90a7fa733000 00000020:01000000:0.0:1789136017.509188:0:15763:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7d28dd840 - data ffff90a7cec3b288/ffff90a7ce932000 00000020:00000080:1.0:1789136017.515165:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de24c1 00000020:00000080:1.0:1789136017.515188:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7c2b6b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789136017.515204:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c2b6b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789136017.515217:0:15763:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7d26b4800 from MGS, refs=2 00000020:01000004:1.0:1789136017.515220:0:15763:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d26b4800 2 00000020:01000004:1.0:1789136017.515223:0:15763:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7d26b4800 from MGS 00000020:00000080:1.0:1789136017.515244:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136017.515251:0:15763:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789136017.515253:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7d26b5000/MGS 00000020:00000080:1.0:1789136017.515255:0:15763:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d26b5000/MGS for MGS 00000020:01000000:1.0:1789136017.515260:0:15763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789136017.515323:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789136017.515326:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136017.515332:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136017.515339:0:15763:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90a7fa559800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136017.515344:0:15763:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90a7efa1ced8) has exports, disconnecting them 00000020:00080000:1.0:1789136017.515348:0:15763:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90a7fa559800), last request at 1789135718 00000020:00000080:1.0:1789136017.515353:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de258c 00000020:00080000:1.0:1789136017.515360:0:15763:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7fa559800): rc 0 00000020:00000080:1.0:1789136017.515364:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7fa559800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789136017.515382:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa559800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789136017.518934:0:15763:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789136017.518944:0:15763:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136017.518949:0:15763:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136017.518957:0:15763:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136017.519186:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136017.519194:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789136017.519203:0:15763:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d26b4800 1 00000020:00000080:0.0:1789136017.519209:0:15763:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de24b3 00000020:00000080:0.0:1789136017.519222:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7c732b800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789136017.519227:0:15763:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789136017.519232:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136017.519235:0:15763:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136017.519239:0:15763:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90a7e6e99a48) has no exports 00000020:00000080:0.0:1789136017.524676:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa558000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789136017.524696:0:37:0:(genops.c:885:class_export_put()) final put ffff90a7fa55e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789136017.524700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa55e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789136017.524708:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789136017.524802:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c732b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789136017.641142:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789136017.765816:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136017.765831:0:15763:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789136017.765837:0:15763:0:(genops.c:885:class_export_put()) final put ffff90a7d26b2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136017.765842:0:15763:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d26b2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789136017.765849:0:15763:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789136017.766104:0:15763:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7d26b7800 00000020:02000400:0.0:1789136017.766181:0:15763:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789136018.686042:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136019.688700:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136019.816117:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136019.816151:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666823936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136019.816224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136019.816342:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666823936 00000100:00100000:3.0:1789136019.816351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666823936 00000100:00100000:3.0:1789136019.816412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789136019.816420:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876044666823936:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789136019.816428:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136019.816467:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1876044666823936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (243us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136019.816475:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:02020000:2.0:1789136019.816614:0:3639:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789136019.831718:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136019.831728:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a7fa5f2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789136019.831733:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789136019.846690:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a7fa5f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136019.846704:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:2.0:1789136019.846715:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a7fa5f2000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136019.846832:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c4464000 x1876044666824064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136019.853524:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666824064:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789136019.853604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136019.853790:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824064 00000100:00100000:0.0:1789136019.853798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824064 00000100:00100000:0.0:1789136019.853985:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789136019.853993:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666824064:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1789136019.854015:0:6521:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789136019.854160:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666824064:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 165us (555us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136019.854168:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:2.0:1789136019.854453:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa5f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136019.854462:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136019.854465:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666824064:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789136020.328235:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1789136020.328679:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136020.328699:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136020.328703:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7fa5f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136020.328712:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1789136020.328726:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136020.328733:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a7fa5f2000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136020.328757:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d930c0 x1876044666824448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136020.328849:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666824320:0@lo:400:kworker.0 00000400:00000100:3.0:1789136020.328920:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044666824320 offset 0 length 224: 4 00000100:00100000:3.0:1789136020.328979:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136020.328985:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666824576:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.329039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.329089:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824576 00000100:00100000:3.0:1789136020.329102:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824576 00000100:00100000:3.0:1789136020.329153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789136020.329739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c44661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876044666824576:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136020.329749:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136020.329809:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c44661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1876044666824576:12345-0@lo:400:kworker.0 Request processed in 74us (770us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136020.329816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1789136020.329890:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789136020.329895:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90a8018dc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789136020.329899:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789136020.329909:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90a8018dc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136020.329912:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 186 00000100:00080000:3.0:1789136020.329918:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a8018dc000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136020.329945:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c4464000 x1876044666824832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136020.331508:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666824576:0@lo:400:kworker.0 00000100:00100000:1.0:1789136020.331667:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666824704:0@lo:400:kworker.0 00000100:00100000:1.0:1789136020.331776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.331865:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824704 00000100:00100000:3.0:1789136020.331874:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824704 00000100:00100000:3.0:1789136020.331926:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789136020.331932:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876044666824704:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136020.331941:0:14528:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136020.332002:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1876044666824704:12345-0@lo:400:kworker.0 Request processed in 69us (228us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136020.332008:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789136020.332398:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666825216:0@lo:400:kworker.0 00000100:00100000:2.0:1789136020.332440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136020.332468:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136020.332473:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666825088:0@lo:400:kworker.0 00000100:00100000:2.0:1789136020.332495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.332540:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666824960:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.332566:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.332582:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666825472:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.332602:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825216 00000100:00100000:3.0:1789136020.332605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825216 00000100:00100000:3.0:1789136020.332623:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824960 00000100:00100000:3.0:1789136020.332625:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824960 00000100:00100000:3.0:1789136020.332653:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789136020.332659:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666824960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.332707:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666824960:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136020.332713:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789136020.332724:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789136020.332728:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876044666825216:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789136020.332733:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789136020.332751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876044666825216:12345-0@lo:400:kworker.0 Request processed in 22us (310us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136020.332756:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1789136020.332768:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136020.334952:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136020.334960:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789136020.334964:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789136020.335282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789136020.335332:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90a7ff5d4000 x1876044666824960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136020.335359:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666824960:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.335378:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136020.335390:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666825344:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.335442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.335481:0:14528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825344 00000100:00100000:3.0:1789136020.335487:0:14528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825344 00000100:00100000:3.0:1789136020.335537:0:14528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1789136020.335545:0:14528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666825344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.335593:0:14528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666825344:12345-0@lo:400:kworker.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136020.335599:0:14528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:3.0:1789136020.335625:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789136020.335641:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90a6c3ceb480 x1876044666825344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136020.335650:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666825344:0@lo:400:kworker.0 00000100:00080000:1.0:1789136020.337061:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789136020.337073:0:3638:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789136020.337080:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789136020.337087:0:3638:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136020.337093:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 206 00000100:00080000:1.0:1789136020.337105:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a6c2a0f000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136020.337171:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ff5e00 x1876044666825600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136020.337196:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666824704:0@lo:400:kworker.0 00000100:00100000:1.0:1789136020.337211:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c44670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666824192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136020.337630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136020.337754:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825088 00000100:00100000:1.0:1789136020.337764:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825088 00000100:00100000:1.0:1789136020.337841:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825472 00000100:00100000:1.0:1789136020.338414:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825472 00000100:00100000:1.0:1789136020.338668:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789136020.338680:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666825088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136020.338774:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666825088:12345-0@lo:400:kworker.0 Request processed in 97us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136020.338783:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789136020.338811:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789136020.338818:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666825472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136020.339205:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666825472:12345-0@lo:400:kworker.0 Request processed in 386us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136020.339213:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1789136020.339274:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136020.339279:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136020.339339:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666825472:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.346322:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824192 00000100:00100000:3.0:1789136020.346337:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824192 00000100:00100000:3.0:1789136020.346415:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789136020.346427:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666824192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136020.346466:0:8433:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789136020.346557:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666824192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (8929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136020.346564:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789136020.346730:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c44670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666824192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136020.355909:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666824448:0@lo:38:kworker.0 00000100:00100000:3.0:1789136020.355999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136020.356133:0:7824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824448 00000100:00100000:1.0:1789136020.356149:0:7824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824448 00000100:00100000:1.0:1789136020.356213:0:7824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789136020.356223:0:7824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1876044666824448:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789136020.356257:0:7824:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136020.356344:0:7824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1876044666824448:12345-0@lo:38:kworker.0 Request processed in 119us (343us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136020.356352:0:7824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789136020.356513:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666824832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789136020.356561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.356595:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666825600:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789136020.356628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136020.356682:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa5f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136020.356687:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136020.356692:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666824448:0@lo:38:kworker.0 00000100:00100000:1.0:1789136020.360786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666824832 00000100:00100000:1.0:1789136020.360808:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666824832 00000100:00100000:1.0:1789136020.361722:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825600 00000100:00100000:1.0:1789136020.361731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825600 00000100:00100000:1.0:1789136020.361775:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789136020.361786:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c2fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666824832:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789136020.361817:0:6515:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136020.363132:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c2fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666824832:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 1327us (6551us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136020.363148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789136020.363195:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789136020.363201:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666825600:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1789136020.363224:0:6515:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136020.363261:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666825600:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (6636us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136020.363286:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789136020.363367:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a8018dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136020.363374:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136020.363379:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4464000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666824832:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1789136020.363391:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136020.363395:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136020.363399:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666825600:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1789136020.371187:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136020.371205:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 228 00000100:00080000:2.0:1789136020.371216:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a7ff502800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136020.371284:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ceb0c0 x1876044666825728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136020.371310:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666825216:0@lo:400:kworker.0 00000100:00100000:2.0:1789136020.371620:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666825088:0@lo:400:kworker.0 00000100:00100000:3.0:1789136020.372062:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666825728:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789136020.372144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136020.372206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825728 00000100:00100000:3.0:1789136020.372213:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825728 00000100:00100000:3.0:1789136020.372258:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789136020.372266:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666825728:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1789136020.372287:0:6516:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136020.372331:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666825728:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 64us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136020.372339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1789136020.372372:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136020.372377:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136020.372379:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666825728:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1789136020.721127:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136020.841297:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666825856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136020.841417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136020.841620:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825856 00000100:00100000:2.0:1789136020.841631:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825856 00000100:00100000:2.0:1789136020.841709:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789136020.841721:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666825856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136020.841765:0:8434:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789136020.841837:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666825856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136020.841844:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789136020.842122:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666825856:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789136021.736222:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789136022.615165:0:15964:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789136022.648134:0:15964:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789136022.648224:0:15964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.648269:0:15964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.648278:0:15964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.648286:0:15964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.648315:0:15964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789136022.648322:0:15964:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789136022.648373:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136022.648379:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136022.648387:0:15964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136022.648397:0:15964:0:(import.c:65:import_set_state_nolock()) ffff90a8018dc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789136022.648403:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136022.648405:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136022.648410:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789136022.648736:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136022.648746:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136022.648755:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802045200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136022.648758:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136022.648769:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136022.648777:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136022.648784:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136022.648788:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789136022.648791:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789136022.648849:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136022.648906:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136022.648952:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136022.648961:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a802045200/0x559c8745c6de2a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a24 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136022.648980:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136022.648982:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136022.648984:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136022.649006:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136022.649032:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666825984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136022.649149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136022.649240:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666825984 00000100:00100000:1.0:1789136022.649251:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666825984 00000100:00100000:1.0:1789136022.649305:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136022.649314:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1876044666825984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789136022.649332:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136022 with bad export cookie 6168954323349677277 00010000:00010000:0.0:1789136022.650276:0:15964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650296:0:15964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650303:0:15964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650310:0:15964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650351:0:15964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136022.650358:0:15964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650364:0:15964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650370:0:15964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650375:0:15964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650386:0:15964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789136022.650392:0:15964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650397:0:15964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650403:0:15964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650408:0:15964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650423:0:15964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789136022.650428:0:15964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650440:0:15964:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650446:0:15964:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650451:0:15964:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136022.650458:0:15964:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789136022.650461:0:15964:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1789136022.650683:0:15964:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789136022.650689:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:2.0:1789136022.650691:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:0.0:1789136022.650696:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136022.650702:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789136022.650711:0:15964:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90a6c3a2b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789136022.650721:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789136022.650722:0:15964:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90a7fa65a000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136022.650744:0:15964:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff90a8018d4ed8) has exports, disconnecting them 00010000:00010000:2.0:1789136022.650754:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044600 already unused, calling callback (ffffffffc13bbc20) 00000020:00080000:0.0:1789136022.650761:0:15964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a6c3a2b000), last request at 1789136020 10000000:00010000:2.0:1789136022.650764:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789136022.650772:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de28bf 00010000:00010000:2.0:1789136022.650780:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136022.650791:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136022.650800:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:0.0:1789136022.650803:0:15964:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 : changing import state from FULL to CLOSED 10000000:01000000:2.0:1789136022.650804:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1789136022.650811:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00080000:0.0:1789136022.650936:0:15964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c3a2b000): rc 0 00000020:00000080:0.0:1789136022.650942:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789136022.650974:0:15964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a7fa65a000), last request at 1789136020 00000020:00000080:0.0:1789136022.650980:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2799 00000100:00080000:0.0:1789136022.650993:0:15964:0:(import.c:65:import_set_state_nolock()) ffff90a8018d9000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136022.651011:0:15964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7fa65a000): rc 0 00000020:00000080:0.0:1789136022.651023:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7fa65a000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789136022.651038:0:15964:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb1d41d2fae0 00000100:00080000:0.0:1789136022.651066:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136022.651090:0:15964:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff90a6c4467840 x1876044666823936/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789136035 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789136022.651106:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136022.651109:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1789136022.651123:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136022.651151:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651159:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a802044600/0x559c8745c6de2a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2a32 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651173:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136022.651177:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651182:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fc00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136022.651192:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651200:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136022.651206:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136022.651211:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136022.651213:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789136022.651215:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789136022.651232:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651237:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136022.651243:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651250:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de28f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de28fe expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651265:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136022.651269:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651274:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ee00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136022.651276:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651283:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136022.651296:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136022.651302:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789136022.651304:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789136022.651306:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789136022.651321:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651327:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136022.651343:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651361:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de2d1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de2d26 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651371:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136022.651374:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651380:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136022.651383:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651390:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136022.651397:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136022.651413:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136022.651415:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789136022.651417:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789136022.651434:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651440:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136022.651447:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651453:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de25e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de25e7 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136022.651475:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136022.651477:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136022.651480:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136022.651491:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136022.651527:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666826240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136022.651629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136022.651706:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4467840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666823936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136022.651742:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136022.651748:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666826112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136022.651775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136022.651806:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666826496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136022.651838:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136022.651894:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136022.651900:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666826368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136022.651935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136022.651968:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666826240 00000100:00100000:2.0:1789136022.651976:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666826240 00000100:00100000:2.0:1789136022.652013:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666826112 00000100:00100000:2.0:1789136022.652017:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666826112 00000100:00100000:2.0:1789136022.652026:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666826496 00000100:00100000:2.0:1789136022.652028:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666826496 00000100:00100000:2.0:1789136022.652036:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666826368 00000100:00100000:2.0:1789136022.652039:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666826368 00000100:00100000:2.0:1789136022.652055:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136022.652063:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1876044666826240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789136022.652072:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136022 with bad export cookie 6168954323349677277 00000100:00100000:2.0:1789136022.652134:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1876044666826240:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (506us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136022.652143:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136022.652164:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789136022.652168:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1876044666826112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789136022.652172:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136022 with bad export cookie 6168954323349677277 00000100:00100000:2.0:1789136022.652197:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3639:x1876044666826112:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (423us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136022.652203:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789136022.652212:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136022.652215:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7cffc6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1876044666826496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789136022.652219:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136022 with bad export cookie 6168954323349677277 00000100:00100000:2.0:1789136022.652246:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7cffc6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1876044666826496:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (408us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136022.652252:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136022.652264:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789136022.652276:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1876044666826368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789136022.652281:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136022 with bad export cookie 6168954323349677277 00000100:00100000:2.0:1789136022.652310:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1876044666826368:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (375us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789136022.652315:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789136022.652360:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136022.652366:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a7d0672000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789136022.652369:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789136022.653746:0:15964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136022.653757:0:15964:0:(import.c:65:import_set_state_nolock()) ffff90a7fa5f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1789136022.654783:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789136022.654947:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa65a000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789136022.654998:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3a2e000 for lustre-MDT0001 00000020:00000080:3.0:1789136022.655003:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a8018d9000 for lustre-MDT0001 00010000:00010000:0.0:1789136022.655923:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136022.660876:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3640:x1876044666825984:12345-0@lo:103:ldlm_bl.0 Request processed in 11531us (11699us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789136022.660891:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789136022.662505:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789136022.666023:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136022.687743:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.131@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789136022.687752:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789136022.687766:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d92940 x1876044666824320/t0(0) o400->MGC192.168.201.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789136036 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136022.687786:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3ff61c0 x1876044666825984/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136038 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136022.687796:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3ce9680 x1876044666826240/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136038 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136022.687806:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3cea1c0 x1876044666826112/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136038 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136022.687815:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3cea940 x1876044666826496/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136038 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136022.687824:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3ceb0c0 x1876044666826368/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136038 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789136022.687834:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789136022.687838:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789136022.687839:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789136022.688932:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90a7d0672000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789136022.689016:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666826496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136022.689060:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:44af6ea5-156e-4935-ba38-1972bb1ada25:3641:1876044666826368:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789136022.690176:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90a7d0672000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789136022.690315:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666824320:0@lo:400:kworker.0 00000100:00080000:0.0:1789136022.690414:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789136022.690420:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789136022.690449:0:15964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136022.690617:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:44af6ea5-156e-4935-ba38-1972bb1ada25:3640:1876044666825984:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789136022.690748:0:15964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789136022.690776:0:15964:0:(import.c:65:import_set_state_nolock()) ffff90a6c2291800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789136022.690800:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789136022.690803:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789136022.690818:0:15964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136022.691070:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666826624:0@lo:9:umount.0 00000100:00100000:3.0:1789136022.691165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789136022.691350:0:15964:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789136022.691363:0:15964:0:(import.c:65:import_set_state_nolock()) ffff90a6c2e9c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789136022.691399:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90a8018d4ed8) has no exports 00000100:00100000:1.0:1789136022.691428:0:8536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666826624 00000100:00100000:1.0:1789136022.691436:0:8536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666826624 00000100:00100000:1.0:1789136022.691502:0:8536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789136022.691512:0:8536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1876044666826624:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789136022.691538:0:8536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de27e6 00000100:00080000:1.0:1789136022.691546:0:8536:0:(import.c:65:import_set_state_nolock()) ffff90a6c2297000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136022.691592:0:8536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789136022.691752:0:8536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1876044666826624:12345-0@lo:9:umount.0 Request processed in 241us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136022.691773:0:8536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789136022.691799:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136022.692027:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666826752:0@lo:9:umount.0 00000100:00100000:3.0:1789136022.692060:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136022.692110:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2291800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136022.692121:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136022.692123:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136022.692126:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666826624:0@lo:9:umount.0 00000100:00100000:1.0:1789136022.692922:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666826752 00000100:00100000:1.0:1789136022.692929:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666826752 00000100:00100000:1.0:1789136022.692984:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789136022.692992:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1876044666826752:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789136022.693015:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2928 00000100:00080000:1.0:1789136022.693021:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136022.693067:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789136022.693219:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3637:x1876044666826752:12345-0@lo:9:umount.0 Request processed in 226us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136022.693226:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:1.0:1789136022.693250:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136022.693274:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2e9c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789136022.693285:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789136022.693287:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136022.693290:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666826752:0@lo:9:umount.0 00000100:00080000:3.0:1789136022.696293:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789136022.697015:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136022.699049:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a7d0672000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136022.699071:0:3639:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 166 00000100:00080000:2.0:1789136022.699104:0:3639:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff90a7d0672000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136022.699187:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3c3c0 x1876044666826880/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136022.699258:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666826240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136022.699293:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44af6ea5-156e-4935-ba38-1972bb1ada25:3637:1876044666826880:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:2.0:1789136022.699298:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:44af6ea5-156e-4935-ba38-1972bb1ada25:3639:1876044666826112:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1789136022.699481:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044666826880 offset 0 length 520: 4 00000020:00080000:1.0:1789136022.725164:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90a8018d4ed8) has no exports 00010000:00010000:0.0:1789136022.760694:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789136022.803651:0:15964:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7f64e3c60 - data ffff90a7cef2b360/ffff90a7fa731c00 00000020:01000000:0.0:1789136022.803839:0:15964:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7fa495420 - data ffff90a7cedd1948/ffff90a7faea4000 00000001:00000004:1.0:1789136022.813403:0:15964:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1789136022.870169:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136022.870179:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1789136022.870188:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789136022.874951:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136022.874960:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1789136022.874987:0:15964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136022.874990:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136022.875735:0:8530:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136022.875741:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789136022.875753:0:8530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789136022.876711:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136022.876717:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1789136022.876733:0:15964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136022.876736:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136022.877586:0:9958:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136022.877591:0:9958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789136022.877604:0:9958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789136022.880395:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2603 00000020:00000080:3.0:1789136022.880407:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0966800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136022.881009:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0966800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789136022.882525:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2618 00000020:00000080:3.0:1789136022.882538:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a8018da800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136022.882559:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789136022.882565:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136022.882573:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789136022.882577:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90a8018d3490) has no exports 00000004:01000000:3.0:1789136022.882748:0:15964:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789136022.882757:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2921 00000020:00000080:3.0:1789136022.882761:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7ff554000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136022.882765:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789136022.882768:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136022.882775:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136022.882777:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff90a6c2b91a48) has no exports 00000020:00000080:3.0:1789136022.882785:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de291a 00000020:00000080:3.0:1789136022.882788:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a6c2e9e800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789136022.883540:0:15964:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789136022.883545:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136022.883549:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789136022.883555:0:15964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136022.883557:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136022.883586:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136022.883594:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789136022.883599:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de27df 00000020:00000080:3.0:1789136022.883604:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a6c2cad000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136022.883609:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789136022.883612:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136022.883615:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136022.883618:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff90a6c2b94ed8) has no exports 00000020:00000080:3.0:1789136022.883622:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de27d8 00000020:00000080:3.0:1789136022.883625:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a6c2290000/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789136022.883992:0:15964:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789136022.884003:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136022.884005:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789136022.884008:0:15964:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136022.884009:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136022.884032:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136022.884037:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789136022.884046:0:15964:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789136022.884051:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de263b 00000020:00000080:3.0:1789136022.884056:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0930000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136022.884060:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789136022.884063:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136022.884066:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136022.884068:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90a8018d0000) has no exports 00000020:00000080:3.0:1789136022.884072:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2634 00000020:00000080:3.0:1789136022.884084:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0930800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136022.884902:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a8018da800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1789136022.884914:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff554000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789136022.884918:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2e9e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136022.884924:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2e9c000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789136022.884942:0:38:0:(genops.c:885:class_export_put()) final put ffff90a7ff550000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136022.884944:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff550000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789136022.884949:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136022.885030:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2cad000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789136022.885036:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2290000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136022.885042:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2291800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789136022.885046:0:38:0:(genops.c:885:class_export_put()) final put ffff90a6c2a0a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136022.885048:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a0a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789136022.885054:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136022.885096:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0930000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789136022.885100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0930800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789136022.947193:0:15964:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789136022.947204:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136022.947933:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789136022.947945:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136022.948006:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136022.948019:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136022.948046:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136022.948050:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136022.948056:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0935000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136022.948062:0:15964:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0935000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789136022.948087:0:15964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136022.948274:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de261f 00000020:00000080:0.0:1789136022.948281:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a8018db000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789136022.948287:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789136022.948292:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136022.948297:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136022.948301:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90a8018d1a48) has no exports 00000020:00000080:0.0:1789136022.948334:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136022.948338:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789136022.948346:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2626 00000020:00000080:0.0:1789136022.948350:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a8018de000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789136022.948360:0:15964:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7fa5f7000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789136022.948364:0:15964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7fa5f7000 2 00000020:01000004:0.0:1789136022.948367:0:15964:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7fa5f7000 from lustre-MDT0001 00000020:00000080:0.0:1789136022.948386:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136022.948402:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789136022.949500:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa5f2000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789136022.949516:0:38:0:(genops.c:885:class_export_put()) final put ffff90a8018df000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136022.949519:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a8018df000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789136022.949533:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136022.949657:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a8018db000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789136022.949662:0:38:0:(genops.c:885:class_export_put()) final put ffff90a8018df800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789136022.949664:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a8018df800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789136022.949668:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789136022.949849:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a8018de000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789136022.950526:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0962000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789136022.950529:0:15964:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0962000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789136022.950539:0:15964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789136022.950600:0:15964:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789136022.950606:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789136022.950611:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136022.950619:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136022.950627:0:15964:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90a7fa412800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136022.950634:0:15964:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90a7e6e9b490) has exports, disconnecting them 00000020:00080000:0.0:1789136022.950639:0:15964:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90a7fa412800), last request at 1789135738 00000020:00000080:0.0:1789136022.950645:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de267a 00000020:00080000:0.0:1789136022.950663:0:15964:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7fa412800): rc 0 00000020:00000080:0.0:1789136022.950668:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7fa412800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789136022.952295:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa412800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789136022.954282:0:15964:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789136022.954291:0:15964:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136022.954296:0:15964:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136022.954303:0:15964:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136022.954331:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a8018dc000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789136022.954540:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136022.954560:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789136022.954566:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0934000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789136022.954569:0:15964:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0934000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789136022.954576:0:15964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789136022.954648:0:15964:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7fa5f7000 1 00000020:00000080:1.0:1789136022.954654:0:15964:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de25b6 00000020:00000080:1.0:1789136022.954661:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7f0966000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789136022.954670:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789136022.954679:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0966000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136022.954688:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136022.954693:0:15964:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136022.954697:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90a7f0944ed8) has no exports 00000020:00000080:1.0:1789136023.351400:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136023.351417:0:15964:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789136023.351425:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7fa5f1000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136023.351430:0:15964:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa5f1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789136023.351445:0:15964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789136023.351596:0:15964:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7fa5f3800 00000020:01000000:1.0:1789136023.351618:0:15964:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789136023.351623:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136023.351628:0:15964:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136023.351632:0:15964:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90a7d184b490) has no exports 00000100:00100000:1.0:1789136023.351748:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90a7e018b400:6515] 0 exiting: rc = 1 00000100:00100000:1.0:1789136023.352014:0:14528:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff90a6c3f40a00:14528] 4 exiting: rc = 0 00000100:00100000:1.0:1789136023.352095:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90a7d18c7a00:6517] 2 exiting: rc = 0 00000100:00100000:1.0:1789136023.352179:0:14529:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff90a6c22c7000:14529] 5 exiting: rc = 0 00000100:00100000:3.0:1789136023.353614:0:8299:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90a7f644b800:8299] 3 exiting: rc = 0 00000100:00100000:3.0:1789136023.353743:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90a7e018a000:6516] 1 exiting: rc = 0 00000100:00100000:1.0:1789136023.354121:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354132:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354137:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354143:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354148:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354170:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354176:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354181:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354186:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354200:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354209:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354215:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354222:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354227:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354232:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354237:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354242:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354247:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354252:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354257:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354262:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354267:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354271:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354276:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354281:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354286:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354292:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354310:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354316:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354322:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354327:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354332:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354337:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354343:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354348:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354353:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354358:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354363:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354369:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354374:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354387:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354393:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354400:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354405:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354410:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354415:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354420:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354426:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354432:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354438:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354443:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354449:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354456:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354460:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354464:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354469:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354475:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354480:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354485:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354491:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354496:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354511:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354518:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.354524:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.366803:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90a7d18c6800:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1789136023.366963:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90a7d18c7000:6518] 0 exiting: rc = 1 00000100:00100000:1.0:1789136023.370682:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370693:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370700:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370707:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370713:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370719:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370725:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370733:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370740:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370746:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370753:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370775:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370785:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370790:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370795:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370800:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370818:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370825:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370831:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370836:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370841:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370846:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370851:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370879:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370885:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370890:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370895:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370901:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370906:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370910:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370916:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370921:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370926:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370930:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370935:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370939:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370944:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370948:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370953:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370957:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370961:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370965:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370970:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370974:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370979:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370984:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.370998:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371003:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371008:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371013:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371018:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371023:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371029:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371034:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371043:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371050:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371055:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371059:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.371065:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.373131:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.373136:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.373141:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.373146:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.373152:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.373778:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90a7cffe5800:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1789136023.374370:0:7824:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff90a7f6449e00:7824] 2 exiting: rc = 0 00000100:00100000:1.0:1789136023.374438:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90a7cffe5200:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1789136023.374493:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.374502:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375623:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375631:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375637:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375644:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375666:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375673:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375679:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375687:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375693:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375699:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375706:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375714:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375741:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375747:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375755:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375763:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375782:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.375789:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376747:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376761:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376768:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376775:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376782:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376789:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.376794:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377081:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377088:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377093:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377122:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377129:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377135:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377141:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377147:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377152:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377158:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377164:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377169:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377174:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377180:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377186:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377207:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377213:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377219:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377224:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377229:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377236:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377241:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377259:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377265:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377270:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377275:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377280:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377310:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377326:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377333:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377339:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377346:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377352:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377357:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377363:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377369:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.377376:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.412793:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90a7cffe5600:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1789136023.420456:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90a7cffe4000:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1789136023.420625:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420634:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420639:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420644:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420649:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420654:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420659:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420663:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420668:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420673:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420678:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420682:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420687:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420691:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420696:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420700:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420705:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420709:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420714:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420718:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420739:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420744:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420748:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420753:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420757:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420761:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420766:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420770:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420775:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420780:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420784:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420788:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.420792:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421169:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421178:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421183:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421189:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421193:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421198:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421204:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421209:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421213:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421219:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421224:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421228:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421233:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421239:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421243:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421248:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421253:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421259:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421264:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421269:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421274:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421279:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421292:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421386:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421397:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421401:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421406:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421410:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421414:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421418:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136023.421423:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.421986:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90a7cffe4c00:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1789136023.424567:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90a7cffe4200:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1789136023.427382:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427402:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427408:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427415:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427424:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427434:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427442:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427448:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427454:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427461:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427468:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427473:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427479:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427485:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427502:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427507:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427527:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427533:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427539:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427544:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427549:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427554:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427560:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427565:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427569:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427574:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427579:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427584:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427589:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427594:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427599:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427605:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427610:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427614:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427620:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427625:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427630:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427634:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427639:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427644:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427649:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427654:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427659:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427664:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427669:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427673:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427679:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427683:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427688:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427693:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427698:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427709:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427714:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427719:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427723:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427728:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427733:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427738:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427743:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427747:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427753:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427760:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427766:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.427773:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.428241:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90a7cffe5400:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1789136023.428251:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90a7cffe4400:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1789136023.432170:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432181:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432187:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432192:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432197:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432204:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432210:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432218:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432224:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432231:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432239:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432246:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432255:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432264:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432271:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432278:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432285:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432292:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.432298:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436507:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436513:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436538:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436543:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436548:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436553:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436557:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436563:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436568:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436573:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436577:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436583:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436589:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436594:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436601:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436608:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436615:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436621:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436626:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436631:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436641:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436646:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436651:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436657:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436662:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436669:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436675:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436680:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436684:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436689:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436696:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436702:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436708:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436713:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436720:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436726:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436733:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436750:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436757:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436766:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436774:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436782:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436789:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436797:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136023.436803:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.437835:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90a7d8335e00:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1789136023.443051:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90a7c7957e00:6530] 2 exiting: rc = 0 00000100:00100000:0.0:1789136023.445176:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90a7c7956800:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1789136023.445269:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445280:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445289:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445296:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445314:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445326:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445332:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445337:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445343:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445365:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445371:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445378:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445383:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445388:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445394:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445399:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445419:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445425:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445431:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445437:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445444:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445451:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445457:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445462:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445468:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445473:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445478:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445484:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445488:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445494:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445500:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445516:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445523:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445528:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445533:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445539:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445544:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445550:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445556:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445561:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445583:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445590:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445596:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445601:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445614:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445620:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445626:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445631:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445636:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445642:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445647:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445653:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445659:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445665:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445671:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445676:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445681:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445687:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445693:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445698:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445703:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445708:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445713:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136023.445719:0:15964:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789136023.455114:0:15964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136023.455128:0:15964:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789136023.455135:0:15964:0:(genops.c:885:class_export_put()) final put ffff90a7e1e05800/MDS_uuid 00000020:00000080:3.0:1789136023.455139:0:15964:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e1e05800/MDS_uuid for MDS 00000020:01000000:3.0:1789136023.455146:0:15964:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789136023.455619:0:15964:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789136023.789310:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136024.809369:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136025.449227:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136025.449244:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136025.449248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136025.449253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136025.449258:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136025.449278:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 468 00000100:00080000:3.0:1789136025.449313:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136025.449323:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a6c2a0f000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136025.449379:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d92580 x1876044666827008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136025.449576:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666827008:0@lo:38:kworker.0 00000400:00000100:0.0:1789136025.449653:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827008 offset 0 length 520: 4 00000100:00080000:3.0:1789136025.449945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136025.449949:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136025.449952:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136025.449956:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 468 00000100:00080000:3.0:1789136025.449959:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136025.449964:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a7ff502800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136025.449980:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d91e00 x1876044666827264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136025.450015:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666827264:0@lo:38:kworker.0 00000400:00000100:3.0:1789136025.450052:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827264 offset 0 length 520: 4 00000100:00100000:0.0:1789136025.450146:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666827392:0@lo:400:kworker.0 00000400:00000100:0.0:1789136025.450171:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827392 offset 0 length 224: 4 00000100:00100000:0.0:1789136025.450195:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136025.450201:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666827136:0@lo:400:kworker.0 00000400:00000100:0.0:1789136025.450225:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827136 offset 0 length 224: 4 00010000:00010000:0.0:1789136025.832727:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136026.863567:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136027.498493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136027.498504:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136027.498507:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136027.498510:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136027.498741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136027.498745:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136027.499166:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666827520:0@lo:400:kworker.0 00000400:00000100:1.0:1789136027.499248:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827520 offset 0 length 224: 4 00000100:00100000:1.0:1789136027.499341:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136027.499350:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666827648:0@lo:400:kworker.0 00000400:00000100:1.0:1789136027.499376:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827648 offset 0 length 224: 4 00010000:00010000:2.0:1789136027.887072:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789136028.846663:0:16166:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789136028.876814:0:16166:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789136028.876919:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136028.876936:0:16166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136028.876945:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136028.876954:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136028.876987:0:16166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789136028.876993:0:16166:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789136028.877018:0:16166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136028.877030:0:16166:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d92580 x1876044666827008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136028.877051:0:16166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136028.877056:0:16166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136028.877062:0:16166:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789136028.877067:0:16166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136028.877070:0:16166:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d92580 x1876044666827008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136040 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136028.877078:0:16166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136028.877081:0:16166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1789136028.877167:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136028.877175:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136028.877183:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ca00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136028.877187:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136028.877196:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136028.877204:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136028.877210:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136028.877219:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789136028.877221:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789136028.877236:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:1.0:1789136028.877240:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136028.877246:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167ca00/0x559c8745c6de2a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2a08 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136028.877258:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136028.877260:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136028.877262:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136028.877357:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666827008:0@lo:38:kworker.0 00000100:00080000:0.0:1789136028.880834:0:16166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136028.880875:0:16166:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d90000 x1876044666827136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136041 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136028.880944:0:16166:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69e9a40 x1876044666827520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136028.880982:0:16166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136028.880988:0:16166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789136028.881014:0:16166:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789136028.884425:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666827520:0@lo:400:kworker.0 00000100:00100000:3.0:1789136028.884580:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666827776:0@lo:39:umount.0 00000400:00000100:3.0:1789136028.884640:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827776 offset 0 length 224: 4 00000100:00100000:2.0:1789136028.886489:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666827136:0@lo:400:kworker.0 00010000:00010000:2.0:1789136028.906262:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789136029.034751:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789136029.034761:0:8425:0:(genops.c:885:class_export_put()) final put ffff90a6c2292000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136029.034934:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2292000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789136029.035000:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2297000 for lustre-OST0000 00000001:00100000:1.0:1789136029.035593:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136029.035599:0:9511:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789136029.035683:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789136029.035714:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3ba1000 for lustre-OST0001 00010000:00010000:2.0:1789136029.928439:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136030.504895:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136030.504907:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136030.504912:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136030.504915:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789136030.505331:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666827904:0@lo:400:kworker.0 00000400:00000100:2.0:1789136030.505411:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666827904 offset 0 length 224: 4 00010000:00010000:1.0:1789136030.952365:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136031.976534:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136033.000244:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136033.000876:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136022/real 1789136022] req@ffff90a6c3e3c3c0 x1876044666826880/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136032 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136033.000917:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3e3c3c0 x1876044666826880/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136032 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136033.000936:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d0672000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136033.000961:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789136033.000965:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44af6ea5-156e-4935-ba38-1972bb1ada25:3637:1876044666826880:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1789136033.001041:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136033.001046:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789136033.001049:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7d0672000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136033.001054:0:487:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1789136033.001060:0:487:0:(import.c:589:import_select_connection()) MGC192.168.201.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136033.001066:0:487:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff90a7d0672000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136033.001119:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d90780 x1876044666828032/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136033.001143:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136033.001147:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136033.001241:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136033.001265:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666828160:0@lo:400:kworker.0 00000400:00000100:0.0:1789136033.001319:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666828160 offset 0 length 224: 4 00000100:00100000:2.0:1789136033.001606:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44af6ea5-156e-4935-ba38-1972bb1ada25:3637:1876044666828032:0@lo:250:kworker.0 00000400:00000100:2.0:1789136033.001637:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044666828032 offset 0 length 520: 4 00010000:00010000:1.0:1789136034.025769:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136035.049847:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136036.072524:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136037.096314:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136038.121310:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136038.125949:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136028/real 1789136028] req@ffff90a7c69e92c0 x1876044666827776/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136038 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136038.125981:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7c69e92c0 x1876044666827776/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136038 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136038.125999:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a0e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789136038.126023:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666827776:0@lo:39:umount.0 00000100:00080000:0.0:1789136038.127057:0:16166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136038.127063:0:16166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136038.127070:0:16166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789136038.128013:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128030:0:16166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128037:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128043:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128090:0:16166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136038.128098:0:16166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128106:0:16166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128113:0:16166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128120:0:16166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136038.128200:0:16166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789136038.128206:0:16166:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789136038.128230:0:16166:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789136038.128234:0:16166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789136038.128239:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136038.128243:0:16166:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789136038.128248:0:16166:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff90a7d1849a48) has no exports 00000020:00080000:0.0:1789136038.128471:0:16166:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff90a7d1849a48) has no exports 00000020:01000000:0.0:1789136038.130164:0:16166:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c39852a0 - data ffff90a7cee80000/ffff90a6c3d77800 00000020:01000000:0.0:1789136038.130287:0:16166:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c2be36c0 - data ffff90a7cee92438/ffff90a7f6855000 00010000:00010000:1.0:1789136038.140994:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136038.141010:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141023:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031e00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136038.141027:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141037:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136038.141045:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136038.141067:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136038.141070:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789136038.141073:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789136038.141090:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:1.0:1789136038.141095:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141101:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de2a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2a16 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141117:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136038.141121:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141128:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136038.141130:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141138:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136038.141144:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136038.141148:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789136038.141151:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789136038.141153:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789136038.141157:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:1.0:1789136038.141160:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141172:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de2d11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2d18 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136038.141182:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136038.141184:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136038.141186:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136038.146001:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789136038.157246:0:16166:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789136038.177362:0:16166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2753 00000020:00000080:1.0:1789136038.177374:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a6c2297800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789136038.177396:0:16166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7e761a000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789136038.177400:0:16166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7e761a000 2 00000020:01000004:1.0:1789136038.177404:0:16166:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7e761a000 from lustre-OST0000 00000020:00000080:1.0:1789136038.177426:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136038.177437:0:16166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789136038.177441:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a6c2293800/lustre-OST0000_UUID 00000020:00000080:1.0:1789136038.177444:0:16166:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2293800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789136038.177453:0:16166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789136038.177526:0:16166:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789136038.177531:0:16166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789136038.177535:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136038.177540:0:16166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136038.177548:0:16166:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90a6c2a0f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136038.177554:0:16166:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff90a7d1848000) has exports, disconnecting them 00000020:00080000:1.0:1789136038.177559:0:16166:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90a6c2a0f800), last request at 1789135757 00000020:00000080:1.0:1789136038.177563:0:16166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de277d 00000020:00080000:1.0:1789136038.177572:0:16166:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c2a0f800): rc 0 00000020:00000080:1.0:1789136038.177950:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a6c2a0f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789136038.185364:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2297800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789136038.185394:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a0f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789136038.191440:0:16166:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789136038.191449:0:16166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136038.191454:0:16166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789136038.191462:0:16166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136038.191532:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2a0f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789136038.191692:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136038.191702:0:16166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789136038.191709:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a6c2292800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789136038.191712:0:16166:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2292800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789136038.191724:0:16166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789136038.191795:0:16166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789136038.191826:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136038.191831:0:16166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789136038.191837:0:16166:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90a6c2a0c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136038.191843:0:16166:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff90a6c2b93490) has exports, disconnecting them 00000020:00080000:2.0:1789136038.191847:0:16166:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90a6c2a0c000), last request at 1789135757 00000020:00000080:2.0:1789136038.191851:0:16166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2792 00000020:00080000:2.0:1789136038.191896:0:16166:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c2a0c000): rc 0 00000020:00000080:2.0:1789136038.191901:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a6c2a0c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789136038.192037:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a0c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789136038.194618:0:16166:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789136038.194626:0:16166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789136038.194630:0:16166:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789136038.194637:0:16166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136038.194669:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2a0e800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789136038.194851:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136038.194876:0:16166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789136038.194881:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a6c2a08000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789136038.194884:0:16166:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a08000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789136038.194892:0:16166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789136038.194955:0:16166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7e761a000 1 00000020:00000080:3.0:1789136038.194961:0:16166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de271b 00000020:00000080:3.0:1789136038.194967:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a7f08ff800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789136038.194987:0:16166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789136038.194994:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f08ff800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789136038.195004:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136038.195008:0:16166:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789136038.195012:0:16166:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90a7d184ced8) has no exports 00000100:00080000:3.0:1789136038.248943:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136038.248955:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136038.248959:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136038.248973:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136038.249047:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136038.249068:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666828288:0@lo:400:kworker.0 00000400:00000100:3.0:1789136038.249126:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666828288 offset 0 length 224: 4 00000020:00000080:1.0:1789136038.332610:0:16166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136038.332624:0:16166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789136038.332630:0:16166:0:(genops.c:885:class_export_put()) final put ffff90a7e761d800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789136038.332644:0:16166:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e761d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789136038.332657:0:16166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789136038.332777:0:16166:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7e761a800 00000020:02000400:1.0:1789136038.332835:0:16166:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789136039.165467:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136040.172967:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136040.191980:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136025/real 1789136025] req@ffff90a6c3d91e00 x1876044666827264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789136040 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136040.192014:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3d91e00 x1876044666827264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789136040 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136040.192587:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136040.193106:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136040.193112:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666827264:0@lo:38:kworker.0 00000100:00080000:0.0:1789136040.203395:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136040.203408:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136040.203430:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136040.203434:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789136040.203438:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136040.203447:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1789136040.203453:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136040.203461:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a7ff502800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136040.203505:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69eb840 x1876044666828416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136040.203599:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136040.203615:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666828544:0@lo:400:kworker.0 00000400:00000100:0.0:1789136040.203677:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666828544 offset 0 length 224: 4 00000100:00100000:3.0:1789136040.203913:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666828416:0@lo:38:kworker.0 00000400:00000100:3.0:1789136040.203937:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666828416 offset 0 length 520: 4 00010000:00010000:2.0:1789136041.192570:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789136041.640100:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136025/real 1789136025] req@ffff90a6c3d92d00 x1876044666827392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136041.685242:0:3639:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff90a6c3d92d00 x1876044666827392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136041.685259:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba6800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789136041.685263:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789136041.714380:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1789136041.714989:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666827392:0@lo:400:kworker.0 00000100:00080000:2.0:1789136041.731264:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136041.731276:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136041.731279:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136041.731289:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136041.731291:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136041.731294:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789136041.731298:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba6800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136041.731308:0:16093:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 228 00000100:00080000:2.0:1789136041.731316:0:16093:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a6c3ba6800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136041.731354:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3c3c0 x1876044666828672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136041.731425:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666828672:0@lo:38:kworker.0 00000400:00000100:2.0:1789136041.731477:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666828672 offset 0 length 520: 4 00010000:00010000:3.0:1789136042.216091:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789136042.619225:0:16368:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789136042.641990:0:16368:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789136042.642086:0:16368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.642101:0:16368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.642108:0:16368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.642115:0:16368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.642193:0:16368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789136042.642199:0:16368:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789136042.642224:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136042.642237:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69eb840 x1876044666828416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136060 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.642266:0:16368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136042.642272:0:16368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136042.642279:0:16368:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789136042.642285:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136042.642289:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69eb840 x1876044666828416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136060 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.642295:0:16368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136042.642298:0:16368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1789136042.642593:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666828416:0@lo:38:kworker.0 00010000:00010000:0.0:1789136042.643823:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136042.643836:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.643848:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136042.643866:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.643877:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136042.643884:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136042.643890:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136042.643908:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789136042.643912:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789136042.643929:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:0.0:1789136042.643934:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.643941:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a802044200/0x559c8745c6de29e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de29ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.643956:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136042.643957:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136042.643959:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136042.644538:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136042.644551:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69e8000 x1876044666827648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644581:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69ebc00 x1876044666827904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644599:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d91680 x1876044666828160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644607:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d91a40 x1876044666828288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136054 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644617:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69eb0c0 x1876044666828544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136056 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644624:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3e3c3c0 x1876044666828672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644640:0:16368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136042.644645:0:16368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789136042.644651:0:16368:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789136042.644655:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136042.644659:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69e8000 x1876044666827648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136043 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644677:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69ebc00 x1876044666827904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136046 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644684:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d91680 x1876044666828160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136049 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644691:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d91a40 x1876044666828288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136054 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644698:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c69eb0c0 x1876044666828544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136056 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644704:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3e3c3c0 x1876044666828672/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136051 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136042.644709:0:16368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136042.644712:0:16368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:0.0:1789136042.644760:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666828544:0@lo:400:kworker.0 00000100:00100000:0.0:1789136042.644784:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666827648:0@lo:400:kworker.0 00000100:00100000:3.0:1789136042.644794:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666828160:0@lo:400:kworker.0 00000100:00100000:3.0:1789136042.644814:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666827904:0@lo:400:kworker.0 00000100:00100000:3.0:1789136042.644845:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666828288:0@lo:400:kworker.0 00000100:00100000:2.0:1789136042.645644:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666828672:0@lo:38:kworker.0 00010000:00010000:1.0:1789136042.646662:0:16368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646676:0:16368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646684:0:16368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646690:0:16368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646713:0:16368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136042.646731:0:16368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646757:0:16368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646763:0:16368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646769:0:16368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136042.646790:0:16368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789136042.646796:0:16368:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789136042.646823:0:16368:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789136042.646828:0:16368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789136042.646833:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136042.646839:0:16368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136042.646844:0:16368:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90a7efa19a48) has no exports 00000020:00080000:1.0:1789136042.647120:0:16368:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90a7efa19a48) has no exports 00010000:00010000:0.0:1789136042.648127:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136042.648137:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648147:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136042.648151:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648161:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136042.648168:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136042.648174:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136042.648190:0:13980:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789136042.648193:0:13980:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789136042.648207:0:13980:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:0.0:1789136042.648211:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648216:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a802044800/0x559c8745c6de29f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de29fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648228:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136042.648231:0:13980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648235:0:13980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136042.648236:0:13980:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648240:0:13980:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136042.648244:0:13980:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136042.648247:0:13980:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789136042.648249:0:13980:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789136042.648250:0:13980:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789136042.648252:0:13980:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:0.0:1789136042.648254:0:13980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648258:0:13980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de2d03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2d0a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.648272:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136042.648273:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136042.648275:0:13980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136042.648784:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789136042.652991:0:16368:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c3985540 - data ffff90a7ceeeb000/ffff90a6c3d76000 00000020:01000000:1.0:1789136042.653170:0:16368:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c3c0ee40 - data ffff90a7ced9ebd0/ffff90a6c3cdcc00 00100000:10000000:1.0:1789136042.671223:0:16368:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789136042.686515:0:16368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2879 00000020:00000080:0.0:1789136042.686526:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a8018d8800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789136042.686546:0:16368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c2291000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789136042.686550:0:16368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c2291000 2 00000020:01000004:0.0:1789136042.686553:0:16368:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a6c2291000 from lustre-OST0001 00000020:00000080:0.0:1789136042.686578:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136042.686586:0:16368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789136042.686589:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a7f08fb800/lustre-OST0001_UUID 00000020:00000080:0.0:1789136042.686592:0:16368:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f08fb800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789136042.686598:0:16368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789136042.686699:0:16368:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 44af6ea5-156e-4935-ba38-1972bb1ada25->MGS 00010000:00010000:0.0:1789136042.686714:0:16368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de25d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136042.686736:0:16368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de25d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136042.686743:0:16368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789136042.686746:0:16368:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789136042.686750:0:16368:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789136042.686772:0:16368:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:0.0:1789136042.686776:0:16368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de25d2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de25d9 expref: -99 pid: 7445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136042.686791:0:16368:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136042.686809:0:16368:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136042.686815:0:16368:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136042.686818:0:16368:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789136042.686819:0:16368:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789136042.686830:0:16368:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d0672000 00010000:00010000:0.0:1789136042.686833:0:16368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de2a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de2a5c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789136042.686850:0:16368:0:(import.c:65:import_set_state_nolock()) ffff90a7d0672000 MGS: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1789136042.686924:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a8018d8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789136042.687103:0:16368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789136042.687106:0:16368:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789136042.687107:0:16368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789136042.687111:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789136042.687121:0:16368:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6c3d90780 x1876044666828032/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789136048 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789136042.687137:0:16368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789136042.687139:0:16368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1789136042.687304:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:44af6ea5-156e-4935-ba38-1972bb1ada25:3637:1876044666828032:0@lo:250:kworker.0 10000000:01000000:0.0:1789136042.687372:0:16368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789136042.687381:0:16368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de24cf 00000020:00000080:0.0:1789136042.687387:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a7c8080800/44af6ea5-156e-4935-ba38-1972bb1ada25 00000020:01000000:0.0:1789136042.687393:0:16368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.131@tcp (flags='') 00000020:00000080:0.0:1789136042.687398:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136042.687403:0:16368:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789136042.687407:0:16368:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90a7efa18000) has no exports 00000020:00000080:1.0:1789136042.687471:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c8080800/44af6ea5-156e-4935-ba38-1972bb1ada25 for MGC192.168.201.131@tcp 10000000:01000000:3.0:1789136042.687787:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789136042.687903:0:16368:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.131@tcp: client import never connected 00000100:00080000:0.0:1789136042.687906:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789136042.687909:0:16368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789136042.687911:0:16368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789136042.687921:0:16368:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789136042.688050:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7d0672000 for MGC192.168.201.131@tcp 00000020:00000080:0.0:1789136042.688190:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136042.688200:0:16368:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.131@tcp (uuid 44af6ea5-156e-4935-ba38-1972bb1ada25) 00000020:00000080:0.0:1789136042.688204:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a7d0677000/44af6ea5-156e-4935-ba38-1972bb1ada25 00000020:00000080:0.0:1789136042.688207:0:16368:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0677000/44af6ea5-156e-4935-ba38-1972bb1ada25 for MGC192.168.201.131@tcp 00000020:01000000:0.0:1789136042.688212:0:16368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.131@tcp (44af6ea5-156e-4935-ba38-1972bb1ada25) 00000020:01000000:0.0:1789136042.688637:0:16368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789136042.688645:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136042.688650:0:16368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136042.688656:0:16368:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90a6c2fd9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136042.688661:0:16368:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff90a6c3a44ed8) has exports, disconnecting them 00000020:00080000:0.0:1789136042.688666:0:16368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90a6c2fd9800), last request at 1789135780 00000020:00000080:0.0:1789136042.688670:0:16368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de28a3 00000020:00080000:0.0:1789136042.688682:0:16368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c2fd9800): rc 0 00000020:00000080:0.0:1789136042.688686:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a6c2fd9800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789136042.688742:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2fd9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789136042.691908:0:16368:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789136042.691916:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136042.691921:0:16368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136042.691938:0:16368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136042.692219:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136042.692228:0:16368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789136042.692234:0:16368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789136042.692238:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136042.692241:0:16368:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789136042.692248:0:16368:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90a6c3ba5800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136042.692254:0:16368:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff90a6c3a41a48) has exports, disconnecting them 00000020:00080000:1.0:1789136042.692258:0:16368:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90a6c3ba5800), last request at 1789135780 00000020:00000080:1.0:1789136042.692262:0:16368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de28b8 00000020:00080000:1.0:1789136042.692277:0:16368:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c3ba5800): rc 0 00000020:00000080:1.0:1789136042.692282:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba5800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789136042.693191:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff502800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789136042.693199:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a6c2fd8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789136042.693202:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2fd8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789136042.693212:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789136042.693276:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba5800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789136042.745728:0:16368:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789136042.745738:0:16368:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136042.745743:0:16368:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136042.745751:0:16368:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136042.746135:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3ba6800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789136042.746289:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789136042.749039:0:13980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789136042.749384:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789136042.749630:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90a7ef9a5400:6499] 1 exiting: rc = 0 00000100:00100000:2.0:1789136042.749956:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90a7d187d400:6498] 0 exiting: rc = 1 00000100:00100000:2.0:1789136042.750017:0:10335:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff90a6c2ddaa00:10335] 2 exiting: rc = 0 00000100:00100000:3.0:1789136042.750093:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.750511:0:13680:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90a6c3f03200:13680] 4 exiting: rc = 0 00000100:00100000:0.0:1789136042.750708:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90a7ef9a4400:6501] 1 exiting: rc = 0 00000100:00100000:0.0:1789136042.750780:0:8446:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90a6c22efa00:8446] 3 exiting: rc = 0 00000100:00100000:2.0:1789136042.753032:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90a7e7605600:6500] 0 exiting: rc = 1 00000100:00100000:2.0:1789136042.753160:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90a7ef9a5e00:6502] 2 exiting: rc = 0 00000100:00100000:3.0:1789136042.753309:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753318:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753328:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753335:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753340:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753346:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753352:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753358:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753364:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753370:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753375:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753381:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753387:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753394:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753400:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753412:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753428:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753435:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753440:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753445:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753451:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753458:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753464:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753469:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753474:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753479:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753484:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753489:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753493:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753499:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753503:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753513:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753518:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753523:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753529:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753534:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753539:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753544:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753549:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753554:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753559:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753565:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753569:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753574:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753580:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753584:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753589:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753594:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753599:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753604:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753608:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753621:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753626:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753630:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753636:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753641:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753646:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753651:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753656:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753661:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753667:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753672:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753690:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.753696:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789136042.755291:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136042.755304:0:16368:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789136042.755310:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a6c2fd8800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789136042.755314:0:16368:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2fd8800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789136042.755320:0:16368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789136042.755373:0:16368:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c2291000 1 00000020:00000080:3.0:1789136042.755379:0:16368:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de2848 00000020:00000080:3.0:1789136042.755385:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a6c2df0000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789136042.755399:0:16368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789136042.755410:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2df0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789136042.755421:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136042.755425:0:16368:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789136042.755429:0:16368:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff90a7f64b4ed8) has no exports 00000020:00000080:3.0:1789136042.784055:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136042.784069:0:16368:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789136042.784076:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a7fa65d800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789136042.784081:0:16368:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa65d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789136042.784087:0:16368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789136042.784518:0:16368:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a6c228b000 00000020:01000000:3.0:1789136042.784551:0:16368:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789136042.784555:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136042.784559:0:16368:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789136042.784563:0:16368:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90a7e6e9ced8) has no exports 00000020:00000080:3.0:1789136042.784744:0:16368:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136042.784750:0:16368:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789136042.784754:0:16368:0:(genops.c:885:class_export_put()) final put ffff90a7f08fa000/OSS_uuid 00000020:00000080:3.0:1789136042.784756:0:16368:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f08fa000/OSS_uuid for OSS 00000020:01000000:3.0:1789136042.784760:0:16368:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789136042.784787:0:6511:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789136042.784986:0:8536:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90a6c2a05e00:8536] 3 exiting: rc = 0 00000100:00100000:1.0:1789136042.785301:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90a7f642c200:8430] 1 exiting: rc = 0 00000100:00100000:1.0:1789136042.785364:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90a7fa608000:8432] 2 exiting: rc = 0 00000100:00100000:1.0:1789136042.785477:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90a7f08ba200:8429] 0 exiting: rc = 1 00000100:00100000:3.0:1789136042.785578:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785592:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785607:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785614:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785620:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785626:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785631:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785635:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785640:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785645:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785650:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785655:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785660:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785667:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785672:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785678:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785683:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785688:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785694:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785699:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785704:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785710:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785729:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785736:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785749:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785754:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785759:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785765:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785770:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785776:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785781:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785786:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785791:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785797:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785801:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785807:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785812:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785817:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785822:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785827:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785833:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785838:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785843:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785849:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785875:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785894:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785899:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785904:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785909:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785915:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785920:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785925:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785930:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785935:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785940:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785945:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785961:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785968:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785979:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785991:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.785996:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.786001:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.786006:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.786011:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.787270:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90a7e08f3e00:8433] 0 exiting: rc = 1 00000100:00100000:0.0:1789136042.789738:0:10096:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90a7d18c4800:10096] 2 exiting: rc = 0 00000100:00100000:2.0:1789136042.789748:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90a7f642c800:8434] 1 exiting: rc = 0 00000100:00100000:3.0:1789136042.790541:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790550:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790556:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790561:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790566:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790572:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790577:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790582:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790587:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790592:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790597:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790601:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790606:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790612:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790616:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790622:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790627:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790632:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790637:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790642:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790647:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790652:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790658:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790663:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790668:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790673:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790678:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790684:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790689:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790707:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790712:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790731:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790736:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790741:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790746:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790751:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.790756:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791138:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791147:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791153:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791157:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791162:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791167:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791172:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791272:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791282:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791287:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791292:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791296:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791301:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791306:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791311:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791316:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791322:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791385:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791393:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791398:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791403:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791407:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791413:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791418:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791424:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791430:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.791435:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.794122:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90a7f644fc00:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1789136042.794466:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90a7f644ee00:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1789136042.795643:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90a7f644fe00:8437] 2 exiting: rc = 0 00000100:00100000:2.0:1789136042.797340:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797350:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797357:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797364:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797369:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797390:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797396:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797401:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797421:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797428:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797435:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797441:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797448:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797454:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797460:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797465:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797471:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797476:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797482:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797488:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797494:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797500:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797506:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797511:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797517:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797522:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797528:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797533:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797538:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797544:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797548:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797554:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797574:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797581:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797586:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797593:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797599:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797604:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797610:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797616:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797628:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797634:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797640:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797646:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797652:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797658:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797663:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797671:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797676:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797681:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797687:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797692:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797698:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797703:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797709:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797727:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797748:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797754:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797759:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797765:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797771:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797777:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797782:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136042.797787:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136042.814794:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90a7f6853200:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1789136042.821375:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90a7fa5b4c00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1789136042.824501:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824510:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824516:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824520:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824531:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824537:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824543:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824548:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824554:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824573:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824578:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824583:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824593:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824599:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824605:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824610:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824615:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824621:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824626:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824632:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824636:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824641:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824647:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824673:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824679:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824686:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824692:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824698:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824703:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824707:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824711:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824725:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824731:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824737:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824746:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.824752:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825458:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825464:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825467:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825472:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825475:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825479:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825482:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825485:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825497:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825501:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825504:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825507:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825511:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825514:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825518:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825521:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825524:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825527:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825531:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825534:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825538:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825542:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825545:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825548:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825551:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825554:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825556:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.825559:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136042.826530:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90a7f6853a00:8440] 0 exiting: rc = 1 00000100:00100000:3.0:1789136042.826659:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90a7f6853600:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1789136042.826764:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826782:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826791:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826797:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826802:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826810:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826816:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826821:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826827:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826832:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826879:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826887:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826893:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826899:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826905:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826923:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826928:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826933:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826939:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826944:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826950:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826957:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826976:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826982:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826987:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826993:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.826998:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827004:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827010:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827016:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827023:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827029:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827035:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827051:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827072:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827081:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827088:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827095:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827101:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827107:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827113:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827119:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827125:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827131:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827136:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827142:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827164:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827172:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827178:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827183:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827197:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827202:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827207:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827213:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827219:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827225:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827230:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827236:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827256:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827263:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827269:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827277:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827282:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136042.827296:0:16368:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789136042.836943:0:16368:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789136066.568670:0:17133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789136078.057589:0:17732:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789136078.057596:0:17732:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789136078.057597:0:17732:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789136078.057718:0:17732:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7d8b2f000 00000020:01000004:2.0:1789136078.057736:0:17732:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789136078.057744:0:17732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789136078.057762:0:17732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90a6c2b93490) 00000020:00000080:2.0:1789136078.057776:0:17732:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789136078.118661:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789136078.119975:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789136078.122238:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.122688:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.122963:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.123218:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.123646:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.123874:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.124114:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.124397:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.124778:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.125008:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.125852:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.126236:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.126681:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.126890:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.127116:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.127398:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.127762:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.127968:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.128188:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.128621:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.128839:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.129114:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.129316:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.129661:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.129882:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.130110:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.130406:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.130789:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.131036:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.131224:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789136078.131626:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.136059:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789136078.138308:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789136078.139647:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789136078.140133:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789136078.140378:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.140657:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.140824:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789136078.141015:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789136078.141178:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.142380:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789136078.142624:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.142762:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.143099:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.143409:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789136078.145065:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.145576:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.145705:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.146169:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.146728:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789136078.147018:0:17732:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1789136078.147709:0:17732:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136078.148222:0:17732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789136078.148231:0:17732:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136078.148256:0:17732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3b26 00000020:01000004:3.0:1789136078.148263:0:17732:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789136078.148278:0:17732:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789136078.148282:0:17732:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7d8b2f000 from MGS 00000020:01000004:3.0:1789136078.148286:0:17732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789136078.148296:0:17732:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90a7f64b4ed8) 00000020:00000080:3.0:1789136078.148305:0:17732:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789136078.148376:0:17732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7d8b2f000 from MGS, refs=2 00080000:01000000:3.0:1789136078.148380:0:17732:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789136078.148384:0:17732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3b34 00000100:00100000:3.0:1789136078.148481:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789136078.148639:0:17732:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789136078.148643:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789136078.149057:0:17732:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789136078.149063:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789136078.149614:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136078.149713:0:17732:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789136078.149716:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789136078.150367:0:17732:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789136078.150375:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789136078.150689:0:17732:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789136078.150695:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789136078.151202:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.151206:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.151208:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.151435:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.151438:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.151440:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136078.151914:0:17732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789136078.154098:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789136078.155991:0:17732:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789136078.156893:0:17744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789136078.156949:0:17732:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789136078.156985:0:17732:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789136078.157688:0:17732:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789136078.158003:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136078.158176:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789136078.158182:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789136078.159145:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789136078.159154:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789136078.159568:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789136078.159575:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1789136078.170409:0:17749:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789136078.170442:0:17732:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789136078.170469:0:17732:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.131@tcp' 00000020:01000004:2.0:1789136078.170471:0:17732:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789136078.170503:0:17732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.131@tcp (typ=mgc) 00000020:00000080:2.0:1789136078.170778:0:17732:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.131@tcp (ffff90a6c2b94ed8) 00000020:00000080:2.0:1789136078.170797:0:17732:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789136078.171130:0:17732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7d8b29800@MGC192.168.201.131@tcp: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136078.171430:0:17732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.131@tcp-0 is initialized 00000040:01000000:2.0:1789136078.171440:0:17732:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789136078.172130:0:17750:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789136078.172210:0:17732:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.131@tcp (uuid 511c13c6-847f-45db-8965-d0deb75673dc) 00000020:00000080:2.0:1789136078.172227:0:17732:0:(genops.c:1385:class_connect()) connect: client 511c13c6-847f-45db-8965-d0deb75673dc, cookie 0x559c8745c6de3b42 00000100:00080000:2.0:1789136078.172238:0:17732:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136078.172254:0:17732:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff90a7d8b29800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136078.172282:0:17732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3cf00 x1876044666828800/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136078.172321:0:17732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 511c13c6-847f-45db-8965-d0deb75673dc->MGS 00000100:00100000:0.0:1789136078.172409:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:511c13c6-847f-45db-8965-d0deb75673dc:3637:1876044666828800:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789136078.172474:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136078.172553:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666828800 00000100:00100000:0.0:1789136078.172559:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666828800 00000100:00100000:0.0:1789136078.172586:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136078.172593:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1876044666828800:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789136078.172612:0:17745:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 511c13c6-847f-45db-8965-d0deb75673dc@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1789136078.172631:0:17745:0:(genops.c:1385:class_connect()) connect: client 511c13c6-847f-45db-8965-d0deb75673dc, cookie 0x559c8745c6de3b49 00000100:00080000:0.0:1789136078.172731:0:17745:0:(import.c:65:import_set_state_nolock()) ffff90a7ff568000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136078.172775:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+5:3637:x1876044666828800:12345-0@lo:250:mount.lustre.0 Request processed in 182us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.172782:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136078.172819:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789136078.172826:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1789136078.172831:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789136078.172835:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789136078.172843:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b29800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789136078.172846:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789136078.172882:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789136078.172887:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:511c13c6-847f-45db-8965-d0deb75673dc:3637:1876044666828800:0@lo:250:mount.lustre.0 00000020:01000004:2.0:1789136078.173179:0:17732:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789136078.173185:0:17732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789136078.173198:0:17732:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90a6c2b91a48) 00000020:00000080:2.0:1789136078.173207:0:17732:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789136078.187004:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136078.187200:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789136078.187208:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789136078.191737:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136078.191751:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789136078.192956:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136078.192965:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789136078.193643:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136078.193790:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789136078.193796:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789136078.194376:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789136078.194383:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789136078.230013:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136078.230579:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789136078.230587:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789136078.231772:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789136078.231781:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789136078.232806:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136078.233190:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789136078.233196:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789136078.234424:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789136078.234435:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789136078.235415:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136078.235616:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789136078.235622:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789136078.236675:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789136078.236683:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789136078.237542:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136078.237725:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789136078.237732:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789136078.238485:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789136078.238492:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789136078.264188:0:17732:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136078.264425:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789136078.264431:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789136078.268347:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136078.268361:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789136078.270669:0:17732:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136078.270680:0:17732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789136078.271743:0:17732:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789136078.271772:0:17732:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789136078.271778:0:17732:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789136078.272135:0:17732:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136078.272185:0:17732:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789136078.272190:0:17732:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136078.272191:0:17732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136078.272192:0:17732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136078.272194:0:17732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136078.272195:0:17732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136078.272196:0:17732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136078.272197:0:17732:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136078.272202:0:17732:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136078.272204:0:17732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136078.272205:0:17732:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136078.272207:0:17732:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789136078.272209:0:17732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136078.272210:0:17732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136078.272211:0:17732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136078.272212:0:17732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136078.272213:0:17732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136078.272213:0:17732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136078.272214:0:17732:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136078.272215:0:17732:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136078.272216:0:17732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136078.272216:0:17732:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136078.272523:0:17732:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789136078.272551:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666828928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136078.272638:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.272706:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7348840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.272793:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666828928 00000100:00100000:0.0:1789136078.272801:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666828928 00000100:00100000:0.0:1789136078.272925:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136078.272935:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+5:17732:x1876044666828928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136078.272986:0:17747:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789136078.272989:0:17747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789136078.272992:0:17747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789136078.273770:0:17769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789136078.275650:0:17747:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1789136078.278534:0:17770:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789136078.278542:0:17770:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789136078.278545:0:17770:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789136078.278548:0:17770:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789136078.278707:0:17770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789136078.279137:0:17747:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789136078.279149:0:17747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789136078.281897:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+5:17732:x1876044666828928:12345-0@lo:253:mount.lustre.0 Request processed in 8955us (9251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.281913:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136078.282057:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666828928:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789136078.282086:0:17732:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789136078.282090:0:17732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789136078.282091:0:17732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789136078.282092:0:17732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136078.282093:0:17732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136078.282094:0:17732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136078.282095:0:17732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136078.282097:0:17732:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789136078.282098:0:17732:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789136078.282099:0:17732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136078.282101:0:17732:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789136078.282120:0:17732:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7d8b2f000 from lustre-MDT0000 10000000:01000000:1.0:1789136078.282173:0:17732:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789136078.282177:0:17732:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789136078.282181:0:17732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a6c2b94ed8 10000000:01000000:1.0:1789136078.282187:0:17732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136078.282196:0:17732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a6c2b94ed8 from 1 10000000:01000000:1.0:1789136078.282200:0:17732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789136078.282235:0:17732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.282482:0:17732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.282493:0:17732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.282518:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136078.282560:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.282611:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.282704:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829056 00000100:00100000:0.0:1789136078.282711:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829056 00000100:00100000:0.0:1789136078.282754:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136078.282763:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+5:17732:x1876044666829056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136078.282776:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136078.282790:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3e000/0x559c8745c6de3b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3b57 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.282812:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3e000/0x559c8745c6de3b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3b57 expref: 6 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.282823:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3e000/0x559c8745c6de3b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3b57 expref: 6 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.282832:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e000, rc 0) 00000100:00100000:0.0:1789136078.282887:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+6:17732:x1876044666829056:12345-0@lo:101:mount.lustre.0 Request processed in 125us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.282893:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136078.283088:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136078.283101:0:17732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.283110:0:17732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.283165:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136078.283189:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.283205:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.283469:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829184 00000100:00100000:0.0:1789136078.283474:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829184 00000100:00100000:0.0:1789136078.283505:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136078.283511:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+6:17732:x1876044666829184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136078.283575:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+6:17732:x1876044666829184:12345-0@lo:501:mount.lustre.0 Request processed in 64us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136078.283593:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136078.283667:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829184:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789136078.283695:0:17732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789136078.283712:0:17732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.283720:0:17732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136078.283728:0:17732:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7d8b2f000 10000000:01000000:1.0:1789136078.283732:0:17732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789136078.283736:0:17732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a7d8b2f000 10000000:01000000:1.0:1789136078.283738:0:17732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789136078.283740:0:17732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a7d8b2f000 from 1 10000000:01000000:1.0:1789136078.283743:0:17732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789136078.283758:0:17732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.283766:0:17732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.283778:0:17732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.283789:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136078.283813:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.283828:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.284454:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829312 00000100:00100000:3.0:1789136078.284459:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829312 00000100:00100000:3.0:1789136078.284537:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136078.284545:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+6:17732:x1876044666829312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136078.284556:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136078.284568:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de3b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3b65 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.284601:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de3b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3b65 expref: 7 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.284609:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de3b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3b65 expref: 7 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.284616:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae000, rc 0) 00000100:00100000:3.0:1789136078.284660:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+7:17732:x1876044666829312:12345-0@lo:101:mount.lustre.0 Request processed in 115us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.284666:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136078.284722:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136078.284735:0:17732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.284742:0:17732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136078.284756:0:17732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789136078.284772:0:17732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.284780:0:17732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136078.284787:0:17732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789136078.284790:0:17732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136078.284795:0:17732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a7d8b2f000 10000000:01000000:1.0:1789136078.284798:0:17732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789136078.284801:0:17732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789136078.284803:0:17732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789136078.284818:0:17732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.284831:0:17732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.284886:0:17732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.284901:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136078.284927:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.285232:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.285443:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829440 00000100:00100000:0.0:1789136078.285448:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829440 00000100:00100000:0.0:1789136078.285475:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136078.285480:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+7:17732:x1876044666829440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136078.285489:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136078.285501:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3f200/0x559c8745c6de3b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3b73 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.285518:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3f200/0x559c8745c6de3b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3b73 expref: 8 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.285526:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3f200/0x559c8745c6de3b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3b73 expref: 8 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.285532:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f200, rc 0) 00000100:00100000:0.0:1789136078.285574:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+8:17732:x1876044666829440:12345-0@lo:101:mount.lustre.0 Request processed in 93us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.285579:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136078.285662:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136078.285673:0:17732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.285681:0:17732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.285752:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136078.285778:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.285800:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.285833:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829568 00000100:00100000:3.0:1789136078.285847:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829568 00000100:00100000:3.0:1789136078.285891:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136078.285897:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+8:17732:x1876044666829568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136078.286036:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+9:17732:x1876044666829568:12345-0@lo:501:mount.lustre.0 Request processed in 137us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.286043:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136078.286133:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829568:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136078.286160:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136078.286195:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.286220:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.286427:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829696 00000100:00100000:3.0:1789136078.286431:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829696 00000100:00100000:3.0:1789136078.286444:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136078.286448:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+9:17732:x1876044666829696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136078.287029:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+9:17732:x1876044666829696:12345-0@lo:503:mount.lustre.0 Request processed in 580us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.287035:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136078.287211:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666829696:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136078.287759:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17771:1876044666829824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136078.287983:0:17771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.288050:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.288091:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829824 00000100:00100000:0.0:1789136078.288095:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829824 00000100:00100000:0.0:1789136078.288128:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789136078.288136:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+9:17771:x1876044666829824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136078.288637:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+9:17771:x1876044666829824:12345-0@lo:502:llog_process_th.0 Request processed in 501us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.288645:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136078.288667:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17771:1876044666829824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789136078.288695:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136078.288707:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136078.288709:0:17771:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789136078.288713:0:17771:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789136078.288716:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136078.288731:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90a6c3a40000) 00000020:00000080:1.0:1789136078.288746:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789136078.288752:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789136078.288819:0:17771:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789136078.288826:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3b88 00000020:00000080:1.0:1789136078.289363:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789136078.289367:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136078.289370:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136078.289371:0:17771:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789136078.289373:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136078.289377:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136078.289378:0:17771:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789136078.289382:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136078.289389:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90a6c3a43490) 00000020:00000080:1.0:1789136078.289399:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789136078.289403:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789136078.289405:0:17771:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789136078.289408:0:17771:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789136078.289413:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789136078.289451:0:17771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7d8b2f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789136078.289461:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90a6c3a41a48) 00000020:00000080:1.0:1789136078.289466:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789136078.289516:0:17771:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789136078.289523:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3b9d 00000020:00000080:1.0:1789136078.289589:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789136078.289594:0:17771:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789136078.289599:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x559c8745c6de3ba4 00080000:01000000:1.0:1789136078.289604:0:17771:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789136078.289607:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3bab 00010000:00010000:1.0:1789136078.355613:0:17771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789136078.356156:0:17771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1789136078.356437:0:17771:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789136078.356964:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90a6c3a44ed8) 00000020:00000080:1.0:1789136078.356984:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789136078.357088:0:17771:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789136078.357095:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3bb9 00000020:00000080:2.0:1789136078.358084:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789136078.360745:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x559c8745c6de3bc0 00000020:00000080:2.0:1789136078.361492:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789136078.361503:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136078.361510:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136078.361512:0:17771:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789136078.361516:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789136078.361519:0:17771:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1789136078.361521:0:17771:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789136078.361522:0:17771:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789136078.361524:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789136078.361527:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136078.361528:0:17771:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789136078.361538:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136078.361543:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136078.361544:0:17771:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789136078.361549:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789136078.361587:0:17771:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789136078.361601:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136078.361604:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136078.361605:0:17771:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789136078.361608:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136078.361611:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136078.361612:0:17771:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789136078.361616:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789136078.361621:0:17771:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:00000080:2.0:1789136078.361648:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136078.361664:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90a6c2b90000) 00000020:00000080:2.0:1789136078.361676:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789136078.361681:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789136078.361735:0:17771:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789136078.361740:0:17771:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789136078.361746:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3bce 00010000:00080000:2.0:1789136078.361778:0:17771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c3a2e000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136078.364653:0:17771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789136078.368613:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136078.368634:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789136078.368680:0:17771:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789136078.368703:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3bd5 00000100:00080000:0.0:1789136078.368714:0:17771:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136078.368721:0:17771:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a6c3a2e000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136078.368758:0:17771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69ea940 x1876044666829952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136078.368838:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666829952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136078.368950:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136078.369082:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666829952 00000100:00100000:3.0:1789136078.369090:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666829952 00000100:00100000:3.0:1789136078.369129:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136078.369137:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666829952:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789136078.369153:0:17758:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789136078.373367:0:17771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789136078.373473:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.373481:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.373484:0:17771:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789136078.373488:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789136078.373492:0:17771:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789136078.373494:0:17771:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136078.373496:0:17771:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136078.373497:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789136078.373500:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.373501:0:17771:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789136078.373504:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789136078.373509:0:17771:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789136078.373512:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.373513:0:17771:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789136078.373517:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789136078.373520:0:17771:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:0.0:1789136078.373544:0:17771:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789136078.373547:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789136078.373563:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a7efa18000) 00000020:00000080:0.0:1789136078.373583:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789136078.373588:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789136078.373662:0:17771:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789136078.373667:0:17771:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789136078.373682:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3be3 00010000:00080000:0.0:1789136078.373715:0:17771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7e761e800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789136078.373958:0:17771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789136078.377457:0:17771:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789136078.377695:0:17771:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789136078.379086:0:17771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136078.380438:0:17771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789136078.380643:0:17771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789136078.389582:0:17777:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136078.389591:0:17777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789136078.390470:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666829952:12345-0@lo:38:llog_process_th.0 Request processed in 21327us (21514us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136078.390484:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789136078.390661:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136078.390668:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136078.390672:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666829952:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1789136078.391972:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136078.391990:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789136078.392037:0:17771:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789136078.392061:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3bea 00000100:00080000:3.0:1789136078.392070:0:17771:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136078.392087:0:17771:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7e761e800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136078.392120:0:17771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d92940 x1876044666830080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136078.392142:0:17771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789136078.392227:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136078.392231:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.392233:0:17771:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789136078.392237:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789136078.392240:0:17771:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789136078.392242:0:17771:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136078.392243:0:17771:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136078.392244:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789136078.392247:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.392249:0:17771:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789136078.392251:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136078.392255:0:17771:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789136078.392258:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.392260:0:17771:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789136078.392263:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789136078.392277:0:17771:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:3.0:1789136078.392300:0:17771:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789136078.392302:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1789136078.392408:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666830080:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789136078.392458:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666830080 offset 0 length 520: 4 00000020:00000080:3.0:1789136078.392536:0:17771:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a7f64b1a48) 00000020:00000080:3.0:1789136078.392549:0:17771:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789136078.392556:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789136078.392616:0:17771:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789136078.392622:0:17771:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789136078.392630:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de3bf8 00010000:00080000:3.0:1789136078.392661:0:17771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7f6293800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136078.393015:0:17771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789136078.393094:0:17771:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789136078.393109:0:17771:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789136078.394792:0:17771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136078.395032:0:17771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789136078.395187:0:17771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789136078.395672:0:17779:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789136078.395679:0:17779:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789136078.396534:0:17771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136078.396547:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789136078.396584:0:17771:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789136078.396603:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3bff 00000100:00080000:3.0:1789136078.396612:0:17771:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136078.396618:0:17771:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136078.396650:0:17771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d90780 x1876044666830208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136078.396719:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666830208:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789136078.396777:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666830208 offset 0 length 520: 4 00000100:00080000:3.0:1789136078.396834:0:17771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789136078.397031:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136078.397035:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.397037:0:17771:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789136078.397039:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136078.397044:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.397056:0:17771:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789136078.397061:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789136078.397064:0:17771:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789136078.397066:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136078.397068:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.397069:0:17771:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789136078.397083:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136078.397086:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.397087:0:17771:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789136078.397090:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789136078.397126:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17771:1876044666830336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136078.397187:0:17771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136078.397207:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136078.397269:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666830336 00000100:00100000:2.0:1789136078.397275:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666830336 00000100:00100000:2.0:1789136078.397331:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136078.397341:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+9:17771:x1876044666830336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136078.397475:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+9:17771:x1876044666830336:12345-0@lo:502:llog_process_th.0 Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136078.397483:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136078.397647:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17771:1876044666830336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789136078.397676:0:17771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136078.397680:0:17771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136078.397682:0:17771:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789136078.397686:0:17771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789136078.397838:0:17732:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1789136078.398117:0:17732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789136078.398133:0:17732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.398144:0:17732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136078.398152:0:17732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d8b2f000 from 1 10000000:01000000:2.0:1789136078.398155:0:17732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136078.398184:0:17732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.398192:0:17732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.398201:0:17732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.398215:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136078.398252:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.398281:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.398531:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666830464 00000100:00100000:0.0:1789136078.398537:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666830464 00000100:00100000:0.0:1789136078.398582:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136078.398591:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+9:17732:x1876044666830464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136078.398602:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136078.398615:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c06 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.398649:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 10 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.398660:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 10 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136078.398674:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e200, rc 0) 00000100:00100000:0.0:1789136078.398711:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+10:17732:x1876044666830464:12345-0@lo:101:mount.lustre.0 Request processed in 122us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.398718:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136078.399061:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136078.399088:0:17732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.399097:0:17732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.399663:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830592:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789136078.399760:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.399845:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.399960:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666830592 00000100:00100000:0.0:1789136078.400204:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666830592 00000100:00100000:0.0:1789136078.400285:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136078.400294:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+10:17732:x1876044666830592:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789136078.400324:0:17745:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789136078.400331:0:17745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789136078.400405:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+10:17732:x1876044666830592:12345-0@lo:256:mount.lustre.0 Request processed in 113us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.400412:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136078.400477:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830592:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789136078.401033:0:17732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136078.401058:0:17732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.401067:0:17732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136078.401086:0:17732:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d8b2f000 from 1 10000000:01000000:2.0:1789136078.401089:0:17732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136078.401117:0:17732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.401125:0:17732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.401132:0:17732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.401149:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136078.401179:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.401475:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.401588:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666830720 00000100:00100000:3.0:1789136078.401594:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666830720 00000100:00100000:3.0:1789136078.401623:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136078.401630:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+10:17732:x1876044666830720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136078.401640:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136078.401652:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c14 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.401673:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 11 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.401683:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 11 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.401706:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caee00, rc 0) 00000100:00100000:3.0:1789136078.401785:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+11:17732:x1876044666830720:12345-0@lo:101:mount.lustre.0 Request processed in 154us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.401791:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136078.402070:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136078.402095:0:17732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.402113:0:17732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.402171:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136078.402197:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.405063:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.405271:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666830848 00000100:00100000:3.0:1789136078.405280:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666830848 00000100:00100000:3.0:1789136078.405439:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789136078.405449:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+11:17732:x1876044666830848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136078.405634:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+11:17732:x1876044666830848:12345-0@lo:501:mount.lustre.0 Request processed in 186us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.405641:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136078.405721:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136078.405771:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136078.405827:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.406676:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.406740:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666830976 00000100:00100000:0.0:1789136078.406746:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666830976 00000100:00100000:0.0:1789136078.406777:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136078.406784:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17732:x1876044666830976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136078.406907:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17732:x1876044666830976:12345-0@lo:503:mount.lustre.0 Request processed in 123us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.406914:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136078.407000:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666830976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136078.407447:0:17781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17781:1876044666831104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136078.407483:0:17781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136078.407504:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831104 00000100:00100000:0.0:1789136078.407507:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831104 00000100:00100000:0.0:1789136078.407523:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136078.407528:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17781:x1876044666831104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136078.408515:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17781:x1876044666831104:12345-0@lo:502:llog_process_th.0 Request processed in 982us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.408525:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136078.408588:0:17781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d8bbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.408606:0:17781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17781:1876044666831104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789136078.408633:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136078.408642:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.408645:0:17781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789136078.408652:0:17781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7d8b2f000 00000020:00000080:0.0:1789136078.408654:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136078.408661:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.408664:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.408665:0:17781:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789136078.408667:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136078.408670:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.408671:0:17781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789136078.408673:0:17781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7d8b2f000 00000020:00000080:0.0:1789136078.408675:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136078.408881:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.408961:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.408963:0:17781:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789136078.408966:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136078.408969:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.408971:0:17781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136078.408975:0:17781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d8b2f000 00000020:00000080:0.0:1789136078.408976:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136078.417460:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.417474:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.417476:0:17781:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136078.417480:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136078.417490:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.417491:0:17781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136078.417497:0:17781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d8b2f000 00000020:00000080:0.0:1789136078.417500:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136078.417549:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.417552:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.417554:0:17781:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136078.417557:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136078.417559:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.417561:0:17781:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789136078.417564:0:17781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d8b2f000 00000020:00000080:0.0:1789136078.417567:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136078.417582:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.417584:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.417585:0:17781:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789136078.417588:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136078.417590:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.417591:0:17781:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789136078.417594:0:17781:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7d8b2f000 00000020:00000080:0.0:1789136078.417596:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789136078.417656:0:17781:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17781:1876044666831232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136078.417739:0:17781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136078.417788:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831232 00000100:00100000:0.0:1789136078.417795:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831232 00000100:00100000:0.0:1789136078.417851:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136078.417880:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17781:x1876044666831232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136078.417987:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17781:x1876044666831232:12345-0@lo:502:llog_process_th.0 Request processed in 108us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136078.417996:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136078.418066:0:17781:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d8bbc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136078.418112:0:17781:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17781:1876044666831232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789136078.418135:0:17781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136078.418139:0:17781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136078.418141:0:17781:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789136078.418144:0:17781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789136078.418370:0:17732:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789136078.418395:0:17732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136078.418417:0:17732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.418430:0:17732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136078.418480:0:17732:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789136078.418483:0:17732:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7d8b2f000 10000000:01000000:2.0:1789136078.418486:0:17732:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7d8b2f000 10000000:01000000:2.0:1789136078.418490:0:17732:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136078.418495:0:17732:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7d8b2f000 from 1 10000000:01000000:2.0:1789136078.418498:0:17732:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789136078.418523:0:17732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.418538:0:17732:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.418549:0:17732:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.418562:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666831360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136078.418599:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.418621:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.422251:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831360 00000100:00100000:3.0:1789136078.422266:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831360 00000100:00100000:3.0:1789136078.422381:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136078.422394:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+11:17732:x1876044666831360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136078.422410:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136078.422429:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caec00/0x559c8745c6de3c29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c22 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.422457:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caec00/0x559c8745c6de3c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c22 expref: 12 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.422469:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caec00/0x559c8745c6de3c29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c22 expref: 12 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.422478:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caec00, rc 0) 00000100:00100000:3.0:1789136078.422564:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666831360:12345-0@lo:101:mount.lustre.0 Request processed in 173us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.422572:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136078.425212:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666831360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136078.425245:0:17732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.425257:0:17732:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.425427:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666831488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136078.425490:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.425544:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136078.425968:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831488 00000100:00100000:3.0:1789136078.425976:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831488 00000100:00100000:3.0:1789136078.426029:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136078.426038:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666831488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136078.426200:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666831488:12345-0@lo:501:mount.lustre.0 Request processed in 163us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.426208:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789136078.426387:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666831488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136078.426426:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666831616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136078.426464:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.430490:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136078.430558:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831616 00000100:00100000:1.0:1789136078.430567:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831616 00000100:00100000:1.0:1789136078.430623:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136078.430634:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666831616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136078.430787:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666831616:12345-0@lo:503:mount.lustre.0 Request processed in 154us (4321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136078.430795:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789136078.434545:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666831616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136078.445173:0:17786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17786:1876044666831744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136078.445262:0:17786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136078.445320:0:17786:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136078.447491:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831744 00000100:00100000:2.0:1789136078.447511:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831744 00000100:00100000:2.0:1789136078.447561:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789136078.447570:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:17786:x1876044666831744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136078.447719:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:17786:x1876044666831744:12345-0@lo:502:llog_process_th.0 Request processed in 149us (2457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136078.447726:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136078.448501:0:17786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17786:1876044666831744:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789136078.448564:0:17786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789136078.448578:0:17786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90a7f64b0000) 00000020:00000080:3.0:1789136078.448595:0:17786:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789136078.448685:0:17786:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7d8b2f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789136078.448689:0:17786:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7d8b2f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789136078.448692:0:17786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d8b2f000 4 00010000:00080000:3.0:1789136078.448723:0:17786:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7fa65d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136078.452242:0:17786:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789136078.453665:0:17786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789136078.453714:0:17786:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789136078.453728:0:17786:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x559c8745c6de3c37 00000100:00080000:3.0:1789136078.453740:0:17786:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136078.453747:0:17786:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a7fa65d000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136078.453794:0:17786:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d91a40 x1876044666831872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136078.453843:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666831872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136078.453936:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136078.453992:0:17786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789136078.454296:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666831872 00000100:00100000:1.0:1789136078.454304:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666831872 00000100:00100000:1.0:1789136078.454528:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136078.454536:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666831872:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136078.454597:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666831872:12345-0@lo:38:llog_process_th.0 Request processed in 60us (660us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789136078.454611:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136078.454664:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136078.454671:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa65d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136078.454674:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789136078.454678:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666831872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136078.456784:0:17786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17786:1876044666832000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136078.456875:0:17786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136078.456911:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832000 00000100:00100000:3.0:1789136078.456918:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832000 00000100:00100000:3.0:1789136078.456954:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136078.456963:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:17786:x1876044666832000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136078.460170:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:17786:x1876044666832000:12345-0@lo:502:llog_process_th.0 Request processed in 3199us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136078.460184:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789136078.466585:0:17786:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa68b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136078.466629:0:17786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17786:1876044666832000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136078.466703:0:17786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17786:1876044666832128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136078.466769:0:17786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.466800:0:17786:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1829780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136078.466844:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832128 00000100:00100000:1.0:1789136078.466848:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832128 00000100:00100000:1.0:1789136078.466943:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136078.466951:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17786:x1876044666832128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136078.467066:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17786:x1876044666832128:12345-0@lo:502:llog_process_th.0 Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136078.467086:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136078.467128:0:17786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:511c13c6-847f-45db-8965-d0deb75673dc:17786:1876044666832128:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789136078.467144:0:17786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789136078.467964:0:17732:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789136078.467992:0:17732:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136078.468040:0:17732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136078.468052:0:17732:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136078.468102:0:17732:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136078.468104:0:17732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136078.468105:0:17732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136078.468107:0:17732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136078.468108:0:17732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136078.468109:0:17732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136078.468111:0:17732:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136078.468112:0:17732:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136078.468113:0:17732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136078.468115:0:17732:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136078.468118:0:17732:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789136078.468123:0:17732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136078.468124:0:17732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136078.468125:0:17732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136078.468126:0:17732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136078.468127:0:17732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136078.468128:0:17732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136078.468129:0:17732:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136078.468130:0:17732:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136078.468131:0:17732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136078.468132:0:17732:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136078.468148:0:17732:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789136078.468159:0:17732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666832256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136078.468196:0:17732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136078.468226:0:17732:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1829d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136078.468280:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832256 00000100:00100000:1.0:1789136078.468285:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832256 00000100:00100000:1.0:1789136078.468380:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789136078.468388:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666832256:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789136078.468406:0:17747:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789136078.468483:0:17747:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789136078.487287:0:17747:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789136078.487301:0:17747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789136078.488581:0:17769:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789136078.488590:0:17769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789136078.488619:0:17769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.488650:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.488659:0:17769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.488701:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.488717:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.489004:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666832384:0@lo:104: 00000100:00100000:1.0:1789136078.489087:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.489132:0:17769:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3e52000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136078.489176:0:17736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832384 00000100:00100000:1.0:1789136078.489183:0:17736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832384 00000100:00100000:1.0:1789136078.489224:0:17736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136078.489234:0:17736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666832384:12345-0@lo:104: 00010000:00010000:1.0:1789136078.489245:0:17736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.489301:0:17736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136078.489577:0:17736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666832384:12345-0@lo:104: Request processed in 343us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136078.489585:0:17736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136078.489627:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666832384:0@lo:104: 00010000:00010000:1.0:1789136078.489645:0:17769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136078.490579:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17732:x1876044666832256:12345-0@lo:253:mount.lustre.0 Request processed in 22189us (22379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136078.490591:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136078.490640:0:17732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:17732:1876044666832256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136078.490652:0:17732:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789136078.490655:0:17732:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136078.490657:0:17732:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136078.490658:0:17732:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136078.490659:0:17732:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136078.490660:0:17732:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136078.490662:0:17732:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136078.490663:0:17732:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136078.490665:0:17732:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136078.490666:0:17732:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136078.490668:0:17732:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136078.490682:0:17732:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789136078.491409:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136078.491499:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.491510:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136078.491514:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.491525:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136078.491532:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136078.491558:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789136078.491618:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.491624:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136078.491648:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.491656:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3c06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c0d expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136078.491675:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.491677:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136078.491678:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136078.491725:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666832512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136078.491766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136078.492554:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832512 00000100:00100000:1.0:1789136078.492562:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832512 00010000:00010000:1.0:1789136078.492598:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.492632:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136078.492641:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+12:3638:x1876044666832512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136078.492654:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136078.492660:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492672:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492688:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3e200/0x559c8745c6de3c0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3c06 expref: 12 pid: 17745 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492701:0:17738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492711:0:17738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789136078.492727:0:17738:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004137616s 00010000:00010000:1.0:1789136078.492732:0:17738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492738:0:17738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492757:0:17738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492764:0:17738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492769:0:17738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136078.492773:0:17738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492781:0:17738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492795:0:17738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492805:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136078.492850:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+11:3638:x1876044666832512:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136078.492874:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789136078.492899:0:17769:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492908:0:17769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136078.492915:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878600/0x559c8745c6de3c3e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136078.492946:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666832512:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789136078.526641:0:17732:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789136078.527313:0:17732:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789136078.527698:0:17796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789136078.528034:0:17732:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1789136078.528129:0:17795:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789136078.528134:0:17795:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:2.0:1789136078.528461:0:17797:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90a6c3e3e940 x1876044666832640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136078.528487:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000040:00080000:1.0:1789136078.528661:0:17796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789136078.529890:0:17732:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789136078.529935:0:17732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789136078.530403:0:17732:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789136078.531524:0:17732:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789136078.531629:0:17732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136078.533700:0:17732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789136078.534114:0:17796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136078.534184:0:17796:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789136078.535080:0:17732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789136078.535136:0:17732:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789136078.536778:0:17732:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1789136078.539367:0:17732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789136078.540964:0:17732:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789136078.541005:0:17732:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1d4189f988 00100000:10000000:0.0:1789136078.541012:0:17732:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789136078.541927:0:17732:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789136078.541945:0:17732:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789136078.541966:0:17732:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789136078.541995:0:17732:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789136078.552980:0:17732:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136078.553217:0:17732:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136079.212768:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136079.464565:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789136079.592046:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 10000000:01000000:0.0:1789136079.975957:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789136079.975966:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d8b2f000 from 7 10000000:01000000:0.0:1789136079.975971:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789136079.976022:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136079.976035:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136079.976073:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136079.976101:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666832768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789136079.976172:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136079.976248:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d0f60180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136079.976320:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832768 00000100:00100000:2.0:1789136079.976327:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832768 00000100:00100000:2.0:1789136079.976394:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136079.976405:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+11:17750:x1876044666832768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136079.976418:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136079.976432:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c45 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136079.976456:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136079.976467:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136079.976487:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4a00, rc 0) 00000100:00100000:2.0:1789136079.976531:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:17750:x1876044666832768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136079.976538:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136079.978566:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666832768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136079.978595:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136079.978606:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136079.978688:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666832896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789136079.978747:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136079.978807:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce847e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136079.978998:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832896 00000100:00100000:2.0:1789136079.979004:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832896 00000100:00100000:2.0:1789136079.979066:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789136079.979076:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17750:x1876044666832896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136079.979095:0:17747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136079.979112:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136079.979115:0:17747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789136079.979217:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:17750:x1876044666832896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136079.979225:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136079.979508:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666832896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789136079.979556:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136079.979563:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136079.979571:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136080.233079:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136080.498318:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789136080.615960:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:3.0:1789136081.257389:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136081.639975:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:3.0:1789136082.280071:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136082.663928:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:1.0:1789136083.319994:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136083.697513:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000100:00080000:0.0:1789136083.818098:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789136083.818105:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789136083.818109:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136083.818117:0:16093:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:0.0:1789136083.818123:0:16093:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136083.818129:0:16093:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a6c3a2e000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136083.818153:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69e83c0 x1876044666833152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136083.818169:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136083.818173:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136083.818176:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136083.818178:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136083.818181:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789136083.818183:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789136083.818185:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a7fa65d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136083.818190:0:16093:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a7fa65d000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136083.818211:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69ead00 x1876044666833280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136083.818258:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136083.818273:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666833024:0@lo:400:kworker.0 00000100:00100000:0.0:1789136083.818351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136083.818416:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666833024 00000100:00100000:0.0:1789136083.818423:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666833024 00000100:00100000:0.0:1789136083.818464:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136083.818472:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:3638:x1876044666833024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136083.818517:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+12:3638:x1876044666833024:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136083.818525:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136083.818559:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833152:0@lo:38:kworker.0 00000100:00100000:0.0:1789136083.818585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136083.818604:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666833280:0@lo:38:kworker.0 00000100:00100000:0.0:1789136083.818632:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136083.818670:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666833152 00000100:00100000:0.0:1789136083.818674:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666833152 00000100:00100000:0.0:1789136083.818694:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136083.818699:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666833152:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789136083.818714:0:17759:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136083.822996:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666833024:0@lo:400:kworker.0 00000100:00100000:3.0:1789136083.828087:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666833280 00000100:00100000:3.0:1789136083.828102:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666833280 00000100:00100000:3.0:1789136083.828153:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136083.828161:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666833280:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789136083.828192:0:17755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1789136083.828229:0:17755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x559c8745c6de3c53 00000004:00100000:3.0:1789136083.828244:0:17755:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789136083.828366:0:17755:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136083.828465:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876044666833280:12345-0@lo:38:kworker.0 Request processed in 303us (9831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136083.828473:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789136083.828524:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7c69ead00 x1876044666833280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136083.828541:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789136083.828549:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789136083.828554:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789136083.828556:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa65d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136083.828563:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666833280:0@lo:38:kworker.0 00000100:00100000:0.0:1789136083.858467:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666833152:12345-0@lo:38:kworker.0 Request processed in 39757us (39870us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136083.858493:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789136083.858880:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136083.858886:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136083.858892:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833152:0@lo:38:kworker.0 00000001:02000400:2.0:1789136084.232977:0:18040:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789136084.334011:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136084.712045:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000020:00000004:1.0:1789136085.266634:0:18092:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136085.267107:0:18092:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789136085.352957:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136085.736307:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000020:00000004:3.0:1789136086.134843:0:18143:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136086.139195:0:18143:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136086.377177:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136086.761507:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:0.0:1789136087.402410:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136087.789489:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:1.0:1789136088.424580:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136088.809084:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000100:00100000:3.0:1789136088.940714:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136078/real 1789136078] req@ffff90a6c3d90780 x1876044666830208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136088.940744:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3d90780 x1876044666830208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136088.940755:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136078/real 1789136078] req@ffff90a6c3d92940 x1876044666830080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136088 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136088.940766:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3d92940 x1876044666830080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136088 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136088.940783:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136088.942315:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789136088.942321:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789136088.942324:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136088.942331:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1789136088.942336:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789136088.942343:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a6c3a2e000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136088.942364:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3f0c0 x1876044666833536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136088.942375:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136088.942379:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136088.942381:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136088.942383:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789136088.942385:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136088.942388:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:2.0:1789136088.942391:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136088.942394:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136088.942418:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3ed00 x1876044666833664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136088.942485:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666833408:0@lo:400:kworker.0 00000100:00100000:2.0:1789136088.942582:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136088.942639:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136088.942645:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666833792:0@lo:400:kworker.0 00000100:00100000:2.0:1789136088.942688:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136088.942719:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666833408 00000100:00100000:2.0:1789136088.942725:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666833408 00000100:00100000:2.0:1789136088.942768:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789136088.942776:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:3640:x1876044666833408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136088.942822:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:3640:x1876044666833408:12345-0@lo:400:kworker.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136088.942829:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789136088.942902:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666833792 00000100:00100000:2.0:1789136088.942906:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666833792 00000100:00100000:2.0:1789136088.942931:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136088.942936:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666833792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136088.942968:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666833792:12345-0@lo:400:kworker.0 Request processed in 32us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136088.942974:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789136088.943006:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a6c3e3de00 x1876044666833792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136088.943017:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666833792:0@lo:400:kworker.0 00000100:00100000:2.0:1789136088.943025:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666833408:0@lo:400:kworker.0 00000100:00080000:3.0:1789136088.944260:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136088.944281:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666830208:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789136088.944294:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136088.944302:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136088.944305:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666830080:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789136088.944330:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833536:0@lo:38:kworker.0 00000100:00100000:3.0:1789136088.944381:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789136088.944464:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136088.944469:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789136088.944472:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136088.944477:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:2.0:1789136088.944481:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136088.944486:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7e761e800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136088.944512:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3fc00 x1876044666833920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136088.944577:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833664:0@lo:8:kworker.0 00000400:00000100:3.0:1789136088.944602:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666833664 offset 0 length 520: 4 00000100:00100000:3.0:1789136088.944630:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833920:0@lo:8:kworker.0 00000400:00000100:3.0:1789136088.944676:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666833920 offset 0 length 520: 4 00000100:00100000:0.0:1789136088.947790:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666833536 00000100:00100000:0.0:1789136088.947807:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666833536 00000100:00100000:1.0:1789136088.951849:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136088.951877:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666833536:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789136088.951908:0:17758:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136088.962368:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666833536:12345-0@lo:38:kworker.0 Request processed in 10484us (17980us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136088.962384:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789136088.962582:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136088.962589:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136088.962593:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833536:0@lo:38:kworker.0 00010000:00010000:0.0:1789136089.448027:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136089.831929:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:1.0:1789136090.471987:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136090.733544:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789136090.855982:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:0.0:1789136091.498231:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136091.880572:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:1.0:1789136092.520033:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136092.903995:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:0.0:1789136093.554453:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789136093.626124:0:18488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789136093.626129:0:18488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789136093.626130:0:18488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789136093.626393:0:18488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a6c3dd6000 00000020:01000004:0.0:1789136093.626410:0:18488:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789136093.626423:0:18488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789136093.626437:0:18488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90a7efa19a48) 00000020:00000080:0.0:1789136093.626454:0:18488:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789136093.834821:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789136093.840935:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789136093.846703:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789136093.847539:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789136093.847805:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789136093.848143:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789136093.848400:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789136093.848602:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789136093.848884:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789136093.849105:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789136093.849518:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789136093.849787:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789136093.850138:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789136093.850456:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789136093.854576:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789136093.854877:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789136093.855252:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789136093.857217:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789136093.857645:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789136093.858309:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789136093.858920:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.859323:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.859547:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.859745:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.860018:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.860722:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.864019:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.864570:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.865512:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.865985:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.866428:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.866706:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.867279:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.867703:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.868134:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.868429:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.869229:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.869677:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.869991:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.870416:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.870739:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.872165:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.872755:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789136093.873382:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.873641:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789136093.874341:0:18488:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00080000:01000000:3.0:1789136093.875478:0:18488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136093.876491:0:18488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789136093.876503:0:18488:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136093.876519:0:18488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de3c61 00000020:01000004:3.0:1789136093.876526:0:18488:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789136093.876547:0:18488:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789136093.876550:0:18488:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789136093.876567:0:18488:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789136093.876594:0:18488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789136093.876598:0:18488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789136093.883818:0:18488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789136093.884467:0:18488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789136093.884473:0:18488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789136093.884475:0:18488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136093.884476:0:18488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136093.884477:0:18488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136093.884478:0:18488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136093.884480:0:18488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136093.884482:0:18488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136093.884484:0:18488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136093.884485:0:18488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789136093.884488:0:18488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789136093.884490:0:18488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136093.884492:0:18488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136093.884493:0:18488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136093.884494:0:18488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136093.884495:0:18488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136093.884497:0:18488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136093.884498:0:18488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136093.884499:0:18488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136093.884500:0:18488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789136093.884527:0:18488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789136093.884632:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834048:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136093.884717:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136093.884845:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c3cad480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136093.885650:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834048 00000100:00100000:2.0:1789136093.885659:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834048 00000100:00100000:2.0:1789136093.885758:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136093.885769:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:18488:x1876044666834048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789136093.885825:0:17747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789136093.885829:0:17747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789136093.885837:0:17747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789136093.886448:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+12:18488:x1876044666834048:12345-0@lo:253:mount.lustre.0 Request processed in 679us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136093.886457:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136093.886544:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789136093.886568:0:18488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789136093.886571:0:18488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789136093.886573:0:18488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789136093.886574:0:18488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136093.886576:0:18488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136093.886577:0:18488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136093.886578:0:18488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136093.886580:0:18488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789136093.886581:0:18488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136093.886583:0:18488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789136093.886604:0:18488:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a6c3dd6000 from lustre-MDT0001 10000000:01000000:1.0:1789136093.886641:0:18488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789136093.886643:0:18488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789136093.886650:0:18488:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a6c2b94ed8 local copy 00010000:00010000:1.0:1789136093.886659:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136093.886749:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136093.886782:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136093.887277:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.887384:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834176 00000100:00100000:0.0:1789136093.887390:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834176 00000100:00100000:0.0:1789136093.887419:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789136093.887425:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:18488:x1876044666834176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136093.887496:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:18488:x1876044666834176:12345-0@lo:501:mount.lustre.0 Request processed in 71us (713us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136093.887503:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136093.887576:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834176:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789136093.887592:0:18488:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789136093.887608:0:18488:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789136093.887615:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.887624:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136093.887649:0:18488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a6c3dd6000 10000000:01000000:1.0:1789136093.887653:0:18488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789136093.887657:0:18488:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a6c2b94ed8 10000000:01000000:1.0:1789136093.887660:0:18488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789136093.887663:0:18488:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a6c2b94ed8 from 1 10000000:01000000:1.0:1789136093.887666:0:18488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789136093.887690:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.887697:0:18488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.887720:0:18488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136093.887733:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136093.887758:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136093.887785:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.887976:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834304 00000100:00100000:0.0:1789136093.887980:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834304 00000100:00100000:0.0:1789136093.887997:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136093.888002:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+12:18488:x1876044666834304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136093.888011:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136093.888023:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3f600/0x559c8745c6de3c6f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c68 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.888053:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3f600/0x559c8745c6de3c6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c68 expref: 13 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.888063:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3f600/0x559c8745c6de3c6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c68 expref: 13 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.888072:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f600, rc 0) 00000100:00100000:0.0:1789136093.888103:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+13:18488:x1876044666834304:12345-0@lo:101:mount.lustre.0 Request processed in 101us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.888109:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136093.888332:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136093.888345:0:18488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888354:0:18488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136093.888369:0:18488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789136093.888387:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888394:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136093.888402:0:18488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a6c3dd6000 10000000:01000000:1.0:1789136093.888405:0:18488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789136093.888408:0:18488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a6c3dd6000 from 1 10000000:01000000:1.0:1789136093.888410:0:18488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789136093.888424:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888431:0:18488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888444:0:18488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136093.888456:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136093.888480:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136093.888500:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.888547:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834432 00000100:00100000:0.0:1789136093.888612:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834432 00000100:00100000:0.0:1789136093.888631:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789136093.888636:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+13:18488:x1876044666834432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136093.888642:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136093.888649:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3ee00/0x559c8745c6de3c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c76 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.888663:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3ee00/0x559c8745c6de3c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c76 expref: 14 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.888670:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3ee00/0x559c8745c6de3c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c76 expref: 14 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.888677:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3ee00, rc 0) 00000100:00100000:0.0:1789136093.888709:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+14:18488:x1876044666834432:12345-0@lo:101:mount.lustre.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.888715:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136093.888771:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136093.888801:0:18488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888809:0:18488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136093.888819:0:18488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789136093.888833:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888840:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136093.888846:0:18488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789136093.888849:0:18488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136093.888878:0:18488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a6c3dd6000 10000000:01000000:1.0:1789136093.888881:0:18488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789136093.888884:0:18488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789136093.888886:0:18488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789136093.888898:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888913:0:18488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.888921:0:18488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136093.888933:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136093.888970:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136093.888982:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.889417:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834560 00000100:00100000:0.0:1789136093.889423:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834560 00000100:00100000:0.0:1789136093.889447:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789136093.889452:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+14:18488:x1876044666834560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136093.889460:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136093.889469:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3fa00/0x559c8745c6de3c8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3c84 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.889484:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3fa00/0x559c8745c6de3c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3c84 expref: 15 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.889492:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3fa00/0x559c8745c6de3c8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c84 expref: 15 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136093.889506:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3fa00, rc 0) 00000100:00100000:0.0:1789136093.889536:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834560:12345-0@lo:101:mount.lustre.0 Request processed in 84us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.889542:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136093.889757:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136093.889770:0:18488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136093.889889:0:18488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136093.895147:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789136093.903203:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136093.923733:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789136093.924323:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789136093.924356:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789136093.924374:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789136093.924389:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1789136093.924402:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1789136093.924413:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1789136093.924425:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789136093.924436:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789136093.924448:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1789136093.924459:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1789136093.924471:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1789136093.924494:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1789136093.924507:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789136093.924521:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789136093.924534:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1789136093.924547:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789136093.925696:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789136093.925721:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1789136093.925733:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789136093.925745:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789136093.925757:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789136093.925768:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000100:00100000:1.0:1789136093.927965:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000040:00080000:2.0:1789136093.928658:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1789136093.928678:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1789136093.928816:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136093.928915:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136093.928973:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.929850:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834688 00000100:00100000:0.0:1789136093.929898:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834688 00000100:00100000:0.0:1789136093.929959:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136093.929968:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136093.930175:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834688:12345-0@lo:501:mount.lustre.0 Request processed in 208us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.930185:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136093.936732:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136093.937340:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136093.937425:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136093.937478:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.938362:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834816 00000100:00100000:0.0:1789136093.938372:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834816 00000100:00100000:0.0:1789136093.938433:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789136093.938444:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834816:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136093.940206:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834816:12345-0@lo:503:mount.lustre.0 Request processed in 1757us (2775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.941892:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789136093.942144:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136093.942589:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136093.942671:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136093.942738:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136093.942805:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.943054:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666834944 00000100:00100000:0.0:1789136093.943061:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666834944 00000100:00100000:0.0:1789136093.943109:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136093.943117:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136093.944603:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666834944:12345-0@lo:502:mount.lustre.0 Request processed in 1480us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.944615:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136093.944817:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666834944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136093.945138:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789136093.945174:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1789136093.945189:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1789136093.945203:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1789136093.945217:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1789136093.945232:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1789136093.945245:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1789136093.945258:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1789136093.945272:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1789136093.945285:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1789136093.945298:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1789136093.945310:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1789136093.945323:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1789136093.945336:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1789136093.945348:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1789136093.945358:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1789136093.945370:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1789136093.945382:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1789136093.945393:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1789136093.945405:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789136093.945416:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789136093.945428:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789136093.945441:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789136093.945454:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789136093.945483:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789136093.945500:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789136093.945514:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789136093.945528:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789136093.945541:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789136093.946207:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789136093.946236:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789136093.946249:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789136093.946263:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789136093.946276:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789136093.946306:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789136093.946319:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789136093.946333:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789136093.946345:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789136093.946358:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789136093.946370:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789136093.946396:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789136093.946410:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789136093.946421:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789136093.946433:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789136093.946476:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666835072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136093.946546:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136093.946608:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136093.946695:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666835072 00000100:00100000:0.0:1789136093.946702:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666835072 00000100:00100000:0.0:1789136093.946755:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789136093.946764:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666835072:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136093.946943:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666835072:12345-0@lo:502:mount.lustre.0 Request processed in 179us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136093.946952:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789136093.947375:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666835072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136093.947447:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789136093.947458:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1789136093.950990:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136093.951008:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136093.951010:0:18492:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789136093.951016:0:18492:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789136093.951019:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136093.951064:0:18492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90a7fc3a9a48) 00000020:00000080:2.0:1789136093.951094:0:18492:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1789136093.951102:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789136093.951196:0:18492:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136093.951204:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de3c99 00000020:00000080:2.0:1789136093.951445:0:18492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789136093.951451:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136093.951455:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136093.951456:0:18492:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789136093.951459:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136093.951463:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136093.951464:0:18492:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789136093.951467:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136093.951475:0:18492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90a7fc3a8000) 00000020:00000080:2.0:1789136093.951491:0:18492:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1789136093.951496:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789136093.951498:0:18492:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789136093.951501:0:18492:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789136093.951506:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136093.951759:0:18492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c3dd6000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789136093.951773:0:18492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90a7fc3ab490) 00000020:00000080:2.0:1789136093.951802:0:18492:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1789136093.952107:0:18492:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789136093.952115:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3cae 00000020:00000080:2.0:1789136093.952217:0:18492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789136093.952225:0:18492:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789136093.952230:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x559c8745c6de3cb5 00080000:01000000:2.0:1789136093.952237:0:18492:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789136093.952240:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de3cbc 00000100:00080000:1.0:1789136094.056287:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789136094.056298:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789136094.056302:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136094.056310:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:1.0:1789136094.056316:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789136094.056324:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a6c3a2e000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136094.056371:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ff4780 x1876044666835200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136094.056410:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136094.056413:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136094.056416:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136094.056419:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136094.056464:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136094.056478:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666835328:0@lo:400:kworker.0 00000100:00100000:1.0:1789136094.056565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.056644:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666835328 00000100:00100000:1.0:1789136094.056651:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666835328 00000100:00100000:1.0:1789136094.056698:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136094.056709:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666835328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136094.056764:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666835328:12345-0@lo:400:kworker.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.056771:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789136094.056833:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a6c3ff70c0 x1876044666835328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136094.056847:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666835328:0@lo:400:kworker.0 00000100:00100000:2.0:1789136094.057044:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666835200:0@lo:38:kworker.0 00000100:00100000:2.0:1789136094.057079:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.057314:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666835200 00000100:00100000:1.0:1789136094.057320:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666835200 00000100:00100000:1.0:1789136094.057350:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136094.057355:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666835200:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789136094.057374:0:17759:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0001: Not available for connect from 0@lo (not set up) 00000100:00100000:1.0:1789136094.068361:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666835200:12345-0@lo:38:kworker.0 Request processed in 10995us (11272us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136094.068396:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789136094.068617:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136094.068624:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136094.068628:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666835200:0@lo:38:kworker.0 00010000:00010000:3.0:1789136094.106582:0:18492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789136094.107695:0:18492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1789136094.108270:0:18492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789136094.112731:0:18492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789136094.112748:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.112757:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.112759:0:18492:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789136094.112763:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.112770:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.112771:0:18492:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789136094.112774:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789136094.112799:0:18492:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:00000080:3.0:1789136094.112831:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136094.112847:0:18492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90a7f64b3490) 00000020:00000080:3.0:1789136094.112892:0:18492:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789136094.112898:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789136094.114155:0:18492:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789136094.114167:0:18492:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789136094.114177:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de3cca 00010000:00080000:3.0:1789136094.114217:0:18492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c44b9800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136094.121121:0:18492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789136094.135667:0:18492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136094.135685:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789136094.135731:0:18492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789136094.135756:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3cd1 00000100:00080000:1.0:1789136094.135768:0:18492:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136094.135774:0:18492:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a6c44b9800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136094.135925:0:18492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ff70c0 x1876044666835456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136094.136068:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666835456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136094.136158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.136329:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666835456 00000100:00100000:2.0:1789136094.136337:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666835456 00000100:00100000:2.0:1789136094.136378:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136094.136386:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666835456:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789136094.136411:0:17758:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1789136094.136442:0:17758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3cd8 00000004:00100000:2.0:1789136094.136458:0:17758:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789136094.136464:0:17758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789136094.136682:0:18492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789136094.136757:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136094.136762:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136094.136764:0:18492:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789136094.136767:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136094.136770:0:18492:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789136094.136772:0:18492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136094.136773:0:18492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136094.136775:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136094.136797:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136094.136798:0:18492:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136094.136801:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136094.136807:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136094.136808:0:18492:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789136094.136811:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789136094.136845:0:18492:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789136094.136884:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136094.136887:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136094.136889:0:18492:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789136094.136892:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136094.136894:0:18492:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789136094.136908:0:18492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136094.136910:0:18492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136094.136912:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136094.136914:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136094.136916:0:18492:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136094.136918:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789136094.136922:0:18492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789136094.136926:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136094.136927:0:18492:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789136094.136930:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136094.136934:0:18492:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:1.0:1789136094.136965:0:18492:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789136094.136968:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136094.136982:0:18492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90a7e6e9ced8) 00000020:00000080:1.0:1789136094.136996:0:18492:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789136094.137002:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136094.137275:0:18492:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789136094.137282:0:18492:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789136094.137290:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de3ce6 00010000:00080000:1.0:1789136094.137320:0:18492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c44be000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1789136094.137543:0:18492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1789136094.141802:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136094.141813:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136094.141816:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136094.141819:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:1.0:1789136094.143590:0:18492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1789136094.145373:0:17758:0:(import.c:65:import_set_state_nolock()) ffff90a7c96ae000 : changing import state from RECOVER to FULL 00000040:01000000:1.0:1789136094.145529:0:18492:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789136094.148243:0:18492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136094.148653:0:18492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789136094.148772:0:18492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:0.0:1789136094.151931:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666835456:12345-0@lo:38:llog_process_th.0 Request processed in 15533us (15761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136094.151958:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1789136094.152342:0:18497:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136094.152347:0:18497:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789136094.153394:0:18492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789136094.153407:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789136094.153451:0:18492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789136094.153475:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3ced 00000100:00080000:2.0:1789136094.153486:0:18492:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136094.153492:0:18492:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a6c44be000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136094.153527:0:18492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3c780 x1876044666835584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136094.153545:0:18492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789136094.153634:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136094.153640:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136094.153642:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136094.153645:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1789136094.153771:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136094.153775:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136094.153798:0:18492:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789136094.153802:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789136094.153805:0:18492:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789136094.153806:0:18492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789136094.153808:0:18492:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789136094.153809:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789136094.153813:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136094.153814:0:18492:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789136094.153817:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789136094.153822:0:18492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789136094.153825:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136094.153826:0:18492:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789136094.153830:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789136094.153834:0:18492:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:2.0:1789136094.153892:0:18492:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789136094.153896:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136094.153907:0:18492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90a7fc3aced8) 00000020:00000080:2.0:1789136094.153926:0:18492:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789136094.153931:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789136094.154007:0:18492:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789136094.154014:0:18492:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789136094.154020:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de3cfb 00010000:00080000:2.0:1789136094.154128:0:18492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2a09000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136094.154324:0:18492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789136094.154389:0:18492:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789136094.154403:0:18492:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1789136094.154902:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136094.154915:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789136094.154922:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789136094.154928:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789136094.154931:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136094.154952:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666835456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136094.154991:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666835584:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789136094.155047:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666835584 offset 0 length 520: 4 00000100:00100000:3.0:1789136094.155491:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666835712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136094.155531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.155688:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666835712 00000100:00100000:1.0:1789136094.155695:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666835712 00000100:00100000:1.0:1789136094.155746:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136094.155763:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1876044666835712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136094.155808:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136094.155876:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1876044666835712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.155883:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136094.156746:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666835712:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789136094.161081:0:18492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136094.162771:0:18492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789136094.162987:0:18492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000020:00000080:3.0:1789136094.164362:0:18492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789136094.164377:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789136094.164417:0:18492:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789136094.164438:0:18492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3d02 00000100:00080000:3.0:1789136094.164449:0:18492:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136094.164455:0:18492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136094.164491:0:18492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d91a40 x1876044666835840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136094.164522:0:18492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789136094.164594:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.164598:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.164600:0:18492:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789136094.164603:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.164607:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.164609:0:18492:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789136094.164612:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789136094.164614:0:18492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789136094.164616:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.164619:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.164620:0:18492:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789136094.164623:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.164625:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.164626:0:18492:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789136094.164638:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789136094.164667:0:18492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.164670:0:18492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.164671:0:18492:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789136094.164674:0:18492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1789136094.164731:0:18488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789136094.164763:0:18488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789136094.164796:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.164808:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136094.164816:0:18488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3dd6000 from 1 10000000:01000000:3.0:1789136094.164819:0:18488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136094.164845:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.164881:0:18488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.164892:0:18488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136094.164913:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666835968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136094.165286:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666835840:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789136094.165331:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666835840 offset 0 length 520: 4 00000100:00100000:3.0:1789136094.165435:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789136094.165565:0:18499:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789136094.165571:0:18499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1789136094.165639:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2ef3780 going to sleep for 11 seconds 00000100:00080000:1.0:1789136094.165964:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136094.165969:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136094.165971:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136094.165974:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136094.169435:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666835968 00000100:00100000:0.0:1789136094.169453:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666835968 00000100:00100000:0.0:1789136094.169533:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136094.169544:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+15:18488:x1876044666835968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136094.169577:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136094.169602:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d09 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.169634:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 16 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.169647:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 16 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.169678:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f400, rc 0) 00000100:00100000:0.0:1789136094.169796:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+16:18488:x1876044666835968:12345-0@lo:101:mount.lustre.0 Request processed in 234us (4340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136094.169803:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136094.170371:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666835968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136094.170393:0:18488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.170403:0:18488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136094.171522:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836096:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789136094.171598:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.171694:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da780 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.173268:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836096 00000100:00100000:2.0:1789136094.173280:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836096 00000100:00100000:2.0:1789136094.173351:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789136094.173361:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+16:18488:x1876044666836096:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789136094.173387:0:17745:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789136094.173409:0:17745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789136094.173413:0:17745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789136094.173541:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+16:18488:x1876044666836096:12345-0@lo:256:mount.lustre.0 Request processed in 181us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.173560:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136094.173773:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836096:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789136094.174704:0:18488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136094.174797:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.174809:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136094.174826:0:18488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c3dd6000 from 1 10000000:01000000:1.0:1789136094.174829:0:18488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136094.174892:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.174900:0:18488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.174909:0:18488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136094.174928:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836224:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136094.174976:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.175015:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136094.175135:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836224 00000100:00100000:3.0:1789136094.175142:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836224 00000100:00100000:3.0:1789136094.175187:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789136094.175195:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+16:18488:x1876044666836224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136094.175213:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136094.175225:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d17 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.175248:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.175258:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.175266:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae800, rc 0) 00000100:00100000:3.0:1789136094.175296:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836224:12345-0@lo:101:mount.lustre.0 Request processed in 102us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.175303:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789136094.175442:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836224:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136094.175455:0:18488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.175464:0:18488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136094.175842:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136094.176242:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136094.176279:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.176308:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.176443:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836352 00000100:00100000:2.0:1789136094.176448:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836352 00000100:00100000:2.0:1789136094.176491:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789136094.176499:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136094.176614:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836352:12345-0@lo:501:mount.lustre.0 Request processed in 115us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.176631:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789136094.176822:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136094.176995:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136094.177116:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.177138:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.179234:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836480 00000100:00100000:2.0:1789136094.179248:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836480 00000100:00100000:2.0:1789136094.179315:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789136094.179324:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136094.179487:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836480:12345-0@lo:503:mount.lustre.0 Request processed in 164us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.179495:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136094.179999:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136094.180474:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136094.181373:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136094.181448:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.181495:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136094.181596:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836608 00000100:00100000:3.0:1789136094.181602:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836608 00000100:00100000:3.0:1789136094.181654:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136094.181664:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136094.181801:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836608:12345-0@lo:502:mount.lustre.0 Request processed in 138us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.181807:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136094.182744:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836608:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136094.183186:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789136094.183219:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789136094.183236:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789136094.183249:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789136094.183261:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789136094.183273:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789136094.183287:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789136094.183300:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 144 off9680 00000040:00080000:1.0:1789136094.183311:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9904 00000040:00080000:1.0:1789136094.183324:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10128 00000040:00080000:1.0:1789136094.183338:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 144 off10272 00000040:00080000:1.0:1789136094.183351:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10496 00000040:00080000:1.0:1789136094.183364:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10720 00000040:00080000:1.0:1789136094.183376:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10848 00000040:00080000:1.0:1789136094.183390:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11072 00000040:00080000:1.0:1789136094.183404:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11296 00000040:00080000:1.0:1789136094.183437:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11424 00000100:00100000:1.0:1789136094.183474:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136094.183531:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.184149:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136094.184338:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836736 00000100:00100000:3.0:1789136094.184345:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836736 00000100:00100000:3.0:1789136094.184400:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136094.184410:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136094.184533:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836736:12345-0@lo:502:mount.lustre.0 Request processed in 123us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.184561:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136094.185239:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136094.185315:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11648 00000040:00080000:1.0:1789136094.185328:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789136094.192089:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.192103:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192106:0:18501:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789136094.192114:0:18501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c3dd6000 00000020:00000080:3.0:1789136094.192116:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136094.192126:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.192128:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192129:0:18501:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789136094.192131:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.192133:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192134:0:18501:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789136094.192138:0:18501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c3dd6000 00000020:00000080:3.0:1789136094.192140:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136094.192218:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.192222:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192223:0:18501:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789136094.192226:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.192229:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192230:0:18501:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136094.192234:0:18501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3dd6000 00000020:00000080:3.0:1789136094.192238:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136094.192255:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.192257:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192259:0:18501:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136094.192261:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.192263:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192265:0:18501:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136094.192268:0:18501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3dd6000 00000020:00000080:3.0:1789136094.192269:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136094.192284:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.192294:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192296:0:18501:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136094.192299:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.192302:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192303:0:18501:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136094.192306:0:18501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3dd6000 00000020:00000080:3.0:1789136094.192309:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136094.192326:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.192329:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192330:0:18501:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136094.192332:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136094.192334:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192335:0:18501:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789136094.192338:0:18501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3dd6000 00000020:00000080:3.0:1789136094.192340:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136094.192363:0:18501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136094.192366:0:18501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136094.192367:0:18501:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789136094.192371:0:18501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000020:01000000:1.0:1789136094.195672:0:18488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789136094.195717:0:18488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136094.195742:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.195755:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136094.195833:0:18488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789136094.195837:0:18488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a6c3dd6000 10000000:01000000:1.0:1789136094.195840:0:18488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a6c3dd6000 10000000:01000000:1.0:1789136094.195844:0:18488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136094.195851:0:18488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6c3dd6000 from 1 10000000:01000000:1.0:1789136094.195870:0:18488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789136094.195911:0:18488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.195921:0:18488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.195934:0:18488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136094.195959:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136094.196042:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.196090:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836864 00000100:00100000:1.0:1789136094.196096:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836864 00000100:00100000:1.0:1789136094.196149:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136094.196158:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+17:18488:x1876044666836864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136094.196171:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136094.196184:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879800/0x559c8745c6de3d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d25 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.196205:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879800/0x559c8745c6de3d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d25 expref: 18 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.196217:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879800/0x559c8745c6de3d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d25 expref: 18 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.196225:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879800, rc 0) 00000100:00100000:1.0:1789136094.196258:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666836864:12345-0@lo:101:mount.lustre.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.196265:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136094.196315:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136094.196337:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136094.196352:0:18488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136094.196361:0:18488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136094.229162:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789136094.229432:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136094.230649:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789136094.230683:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1789136094.230696:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1789136094.230707:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1789136094.230718:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1789136094.230729:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1789136094.230739:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1789136094.230750:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1789136094.230760:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1789136094.230771:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1789136094.230953:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1789136094.230969:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1789136094.230992:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1789136094.231006:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1789136094.231018:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1789136094.231115:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1789136094.231128:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1789136094.231157:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1789136094.231172:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1789136094.231186:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1789136094.231199:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1789136094.231213:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1789136094.231225:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1789136094.231237:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1789136094.231249:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1789136094.231261:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1789136094.231274:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1789136094.231288:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1789136094.231312:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1789136094.231319:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789136094.231427:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136094.231502:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136094.232635:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c6de7300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136094.238971:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666836992 00000100:00100000:1.0:1789136094.238987:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666836992 00000100:00100000:1.0:1789136094.239066:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136094.239077:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666836992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136094.239293:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666836992:12345-0@lo:501:mount.lustre.0 Request processed in 218us (7791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.239302:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136094.241358:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666836992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136094.241424:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136094.241494:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.241539:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136094.243725:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837120 00000100:00100000:1.0:1789136094.243741:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837120 00000100:00100000:1.0:1789136094.243827:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136094.243838:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837120:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136094.244253:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837120:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136094.244734:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136094.244875:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136094.244931:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.244958:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.244981:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837248 00000100:00100000:2.0:1789136094.244986:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837248 00000100:00100000:2.0:1789136094.245012:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136094.245019:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:18488:x1876044666837248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136094.246992:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:18488:x1876044666837248:12345-0@lo:502:mount.lustre.0 Request processed in 1968us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.247001:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789136094.247120:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+19:18488:x1876044666837120:12345-0@lo:503:mount.lustre.0 Request processed in 3281us (5624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.247128:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789136094.247273:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136094.247484:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789136094.247515:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1789136094.247530:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1789136094.247543:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1789136094.248521:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1789136094.248536:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1789136094.248629:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1789136094.248648:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1789136094.248661:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1789136094.248672:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1789136094.248701:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1789136094.248716:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1789136094.248728:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1789136094.248742:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1789136094.248755:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1789136094.248767:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1789136094.250134:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1789136094.250186:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1789136094.250202:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1789136094.250216:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1789136094.250231:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1789136094.250243:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1789136094.250255:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1789136094.250270:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1789136094.250283:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1789136094.250298:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1789136094.250336:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1789136094.250352:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1789136094.250366:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1789136094.250379:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1789136094.250394:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1789136094.250420:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1789136094.250433:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1789136094.250446:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1789136094.250458:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1789136094.250472:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1789136094.250486:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1789136094.250501:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1789136094.250516:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1789136094.250529:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1789136094.250541:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1789136094.250572:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1789136094.250597:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1789136094.250611:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1789136094.250623:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1789136094.250635:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1789136094.250648:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1789136094.250663:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1789136094.250725:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136094.257984:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.258161:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837376 00000100:00100000:2.0:1789136094.258169:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837376 00000100:00100000:2.0:1789136094.267774:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136094.267804:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136094.267980:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837376:12345-0@lo:502:mount.lustre.0 Request processed in 193us (10004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.267988:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136094.272717:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.272771:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136094.273361:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1789136094.273400:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1789136094.273440:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136094.273511:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.273630:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136094.273672:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837504 00000100:00100000:1.0:1789136094.273679:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837504 00000100:00100000:1.0:1789136094.273740:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136094.273749:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136094.273924:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837504:12345-0@lo:502:mount.lustre.0 Request processed in 176us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.273932:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136094.273973:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136094.274015:0:18488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789136094.274023:0:18488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789136094.279434:0:18508:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789136094.279452:0:18508:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90a7d184ced8) 00000020:00000080:3.0:1789136094.279473:0:18508:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789136094.279544:0:18508:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c3dd6000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789136094.279548:0:18508:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c3dd6000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789136094.279550:0:18508:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c3dd6000 3 00010000:00080000:3.0:1789136094.279578:0:18508:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7d0676000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136094.281311:0:18508:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789136094.281523:0:18508:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789136094.281562:0:18508:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789136094.281583:0:18508:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x559c8745c6de3d3a 00000100:00080000:3.0:1789136094.281593:0:18508:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136094.281599:0:18508:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a7d0676000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136094.281633:0:18508:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d93840 x1876044666837632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136094.281682:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666837632:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136094.281750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136094.281832:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837632 00000100:00100000:3.0:1789136094.281838:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837632 00000100:00100000:3.0:1789136094.281893:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136094.281900:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666837632:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789136094.281925:0:17755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1789136094.281963:0:17755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x559c8745c6de3d41 00000004:00100000:3.0:1789136094.281978:0:17755:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789136094.282009:0:17755:0:(import.c:65:import_set_state_nolock()) ffff90a7c2b6b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136094.282059:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876044666837632:12345-0@lo:38:llog_process_th.0 Request processed in 157us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.282066:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789136094.282103:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a6c3d93840 x1876044666837632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136094.282113:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136094.282120:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789136094.282127:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789136094.282132:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789136094.282134:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136094.282140:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666837632:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789136094.282165:0:18508:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789136094.282187:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136094.282192:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136094.282195:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136094.282197:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789136094.288573:0:18508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1789136094.289276:0:18488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789136094.289308:0:18488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136094.289327:0:18488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.289339:0:18488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136094.289399:0:18488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136094.289402:0:18488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136094.289403:0:18488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136094.289404:0:18488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136094.289406:0:18488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136094.289407:0:18488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136094.289409:0:18488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136094.289410:0:18488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136094.289412:0:18488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136094.289416:0:18488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789136094.289418:0:18488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136094.289419:0:18488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136094.289420:0:18488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136094.289421:0:18488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136094.289423:0:18488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136094.289424:0:18488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136094.289425:0:18488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136094.289426:0:18488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136094.289427:0:18488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136094.289453:0:18488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789136094.289473:0:18488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136094.289543:0:18488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.289600:0:18488:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.289623:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837760 00000100:00100000:2.0:1789136094.289629:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837760 00000100:00100000:2.0:1789136094.289677:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789136094.289685:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789136094.289712:0:17746:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789136094.289725:0:17746:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789136094.292235:0:17733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789136094.292271:0:17746:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789136094.292282:0:17746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789136094.293129:0:17769:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136094.293136:0:17769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136094.293158:0:17769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.293176:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 18 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.293185:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 18 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.293192:0:17769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.293234:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 18 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.293248:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 18 pid: 17747 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136094.293265:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666837888:0@lo:104: 00000100:00100000:2.0:1789136094.293345:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136094.294106:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:18488:x1876044666837760:12345-0@lo:253:mount.lustre.0 Request processed in 4418us (4560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.294118:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789136094.294338:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 17 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.294348:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 17 pid: 17745 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136094.294358:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666838016:0@lo:104: 00000100:00100000:2.0:1789136094.295281:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136094.295326:0:17769:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136094.295372:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666837888 00000100:00100000:2.0:1789136094.295381:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666837888 00000100:00100000:2.0:1789136094.295641:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838016 00000100:00100000:2.0:1789136094.295645:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838016 00000100:00100000:2.0:1789136094.295662:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136094.295672:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:17769:x1876044666837888:12345-0@lo:104: 00010000:00010000:2.0:1789136094.295690:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.295754:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789136094.295759:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:17769:x1876044666837888:12345-0@lo:104: Request processed in 89us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.295766:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136094.296367:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136094.296376:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666838016:12345-0@lo:104: 00010000:00010000:2.0:1789136094.296396:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136094.296446:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789136094.296463:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666838016:12345-0@lo:104: Request processed in 88us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136094.296470:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136094.296515:0:18488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:18488:1876044666837760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136094.296529:0:18488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789136094.296532:0:18488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136094.296534:0:18488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136094.296535:0:18488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136094.296536:0:18488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136094.296537:0:18488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136094.296538:0:18488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136094.296540:0:18488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136094.296542:0:18488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136094.296543:0:18488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136094.296573:0:18488:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789136094.297028:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136094.297038:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297046:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136094.297050:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297059:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136094.297065:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136094.297070:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136094.297108:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297114:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136094.297140:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297148:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c3cae200/0x559c8745c6de3d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d10 expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297171:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136094.297174:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297180:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136094.297182:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297190:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136094.297196:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136094.297201:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136094.297216:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297221:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136094.297228:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297235:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3c45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c4c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136094.297248:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136094.297250:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136094.297251:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136094.297294:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666838272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136094.297340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136094.297381:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136094.297851:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666838144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136094.298576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136094.298636:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838272 00000100:00100000:3.0:1789136094.298644:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838272 00010000:00010000:3.0:1789136094.298678:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 18 pid: 17745 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136094.298714:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838144 00000100:00100000:3.0:1789136094.298717:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838144 00010000:00010000:3.0:1789136094.298730:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 19 pid: 17747 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136094.298744:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136094.298752:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+19:3641:x1876044666838272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136094.298783:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136094.298800:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 19 pid: 17745 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298810:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 19 pid: 17745 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298828:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136094.298881:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+19:3641:x1876044666838272:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.298888:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136094.298904:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136094.298910:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+18:3641:x1876044666838144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136094.298918:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136094.298922:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 18 pid: 17747 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298932:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 18 pid: 17747 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298944:0:17738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298952:0:17738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789136094.298967:0:17738:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005832025s 00010000:00010000:3.0:1789136094.298972:0:17738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298990:0:17738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.298996:0:17738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.299003:0:17738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.299009:0:17738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136094.299013:0:17738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.299022:0:17738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.299031:0:17738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.299041:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136094.299066:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+18:3641:x1876044666838144:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136094.299072:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136094.299109:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666838144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136094.299118:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666838272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136094.304079:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136094.304144:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3f400/0x559c8745c6de3d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3d09 expref: 17 pid: 17747 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136094.304186:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666837888:0@lo:104: 00010000:00010000:3.0:1789136094.304203:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3c4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3c45 expref: 16 pid: 17745 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136094.304213:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666838016:0@lo:104: 00010000:00010000:3.0:1789136094.304238:0:17769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.304247:0:17769:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.304254:0:17769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136094.304260:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3d48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1789136094.311214:0:18488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789136094.311670:0:18515:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789136094.311679:0:18515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789136094.315394:0:18516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789136094.315810:0:18488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789136094.316595:0:18516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136094.318468:0:18516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136094.318532:0:18516:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789136094.319831:0:18517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18517:1876044666838400:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.319930:0:18517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.319994:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838400 00000100:00100000:1.0:1789136094.320000:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838400 00000100:00100000:1.0:1789136094.320062:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136094.320071:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18517:x1876044666838400:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.320152:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18517:x1876044666838400:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.320161:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136094.320190:0:18517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136094.320214:0:18517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18517:1876044666838400:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789136094.320243:0:18517:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789136094.320267:0:18517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18517:1876044666838528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.320294:0:18517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.320311:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838528 00000100:00100000:1.0:1789136094.320314:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838528 00000100:00100000:1.0:1789136094.320332:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136094.320337:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18517:x1876044666838528:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.320748:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18517:x1876044666838528:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 409us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136094.320756:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136094.320776:0:18517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136094.320799:0:18517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18517:1876044666838528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.320871:0:18517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18517:1876044666838656:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.320905:0:18517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.320929:0:18517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881780 going to sleep for 11 seconds 00000100:00100000:0.0:1789136094.320995:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838656 00000100:00100000:0.0:1789136094.321000:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838656 00000100:00100000:0.0:1789136094.321042:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136094.321049:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18517:x1876044666838656:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789136094.321091:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18517:x1876044666838656:12345-0@lo:900:lod0001_rec0000.0 Request processed in 42us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136094.321097:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789136094.321175:0:18517:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a6c3ff4000 x1876044666838656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136094.321198:0:18517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18517:1876044666838656:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.321241:0:18517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18517:1876044666838784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136094.321269:0:18517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136094.321294:0:18517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136094.321341:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838784 00000100:00100000:0.0:1789136094.321345:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838784 00000100:00100000:0.0:1789136094.321373:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789136094.321379:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18517:x1876044666838784:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789136094.321427:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18517:x1876044666838784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 48us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136094.321434:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136094.321493:0:18517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18517:1876044666838784:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789136094.321533:0:18517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789136094.325272:0:18488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789136094.325310:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789136094.328396:0:18488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:1.0:1789136094.328663:0:18517:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136094.328739:0:18517:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789136094.328744:0:18517:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:01000000:2.0:1789136094.330951:0:18488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789136094.331069:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136094.333327:0:18488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789136094.334486:0:18488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789136094.334690:0:18488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789136094.337070:0:18488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789136094.337521:0:18488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1789136094.339479:0:18488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789136094.344443:0:18488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789136094.344489:0:18488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1d41c47988 00100000:10000000:3.0:1789136094.344498:0:18488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789136094.345722:0:18488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789136094.345760:0:18488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789136094.345796:0:18488:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789136094.345815:0:18488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1789136094.347828:0:18488:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136094.348097:0:18488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136094.573701:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136094.954268:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000040:00080000:1.0:1789136095.354415:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136095.593141:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136095.976237:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 10000000:01000000:2.0:1789136096.169001:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136096.169009:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3dd6000 from 8 10000000:01000000:2.0:1789136096.169014:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136096.169063:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.169075:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.169105:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136096.169134:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666838912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136096.169208:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136096.169282:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136096.169388:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666838912 00000100:00100000:0.0:1789136096.169396:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666838912 00000100:00100000:0.0:1789136096.169456:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789136096.169468:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+16:17750:x1876044666838912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136096.169482:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136096.169496:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d4f expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.169523:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 17 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.169535:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 17 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.169552:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3f800, rc 0) 00000100:00100000:0.0:1789136096.169602:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666838912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136096.169609:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789136096.173199:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666838912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136096.173230:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.173242:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136096.173326:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666839040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789136096.173393:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136096.173446:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136096.173557:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839040 00000100:00100000:3.0:1789136096.173565:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839040 00000100:00100000:3.0:1789136096.173618:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789136096.173627:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666839040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789136096.173646:0:17746:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789136096.173661:0:17746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789136096.173664:0:17746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789136096.173765:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666839040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136096.173773:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789136096.173889:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666839040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789136096.173932:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136096.173939:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.173948:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136096.173959:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136096.173961:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d8b2f000 from 8 10000000:01000000:2.0:1789136096.173968:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136096.173991:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.173999:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136096.174008:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136096.174020:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666839168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136096.174045:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136096.174074:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889840 going to sleep for 11 seconds 00000100:00100000:3.0:1789136096.174238:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839168 00000100:00100000:3.0:1789136096.174244:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839168 00000100:00100000:3.0:1789136096.174277:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789136096.174284:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666839168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136096.174292:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136096.174304:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d5d expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136096.174324:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 18 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136096.174334:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 18 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136096.174342:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:3.0:1789136096.174382:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666839168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136096.174388:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136096.174469:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666839168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136096.174480:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.174487:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136096.174526:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666839296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789136096.174555:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136096.174580:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e82300 going to sleep for 11 seconds 00000100:00100000:2.0:1789136096.175049:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839296 00000100:00100000:2.0:1789136096.175055:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839296 00000100:00100000:2.0:1789136096.175107:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789136096.175115:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666839296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136096.175128:0:17746:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136096.175143:0:17746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136096.175146:0:17746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789136096.175460:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666839296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 345us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136096.175467:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789136096.175549:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666839296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789136096.175589:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789136096.175597:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136096.175604:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136096.362100:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136096.616152:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136097.002804:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:1.0:1789136097.652691:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136098.024647:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00010000:00010000:2.0:1789136098.666559:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136099.051217:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 0 seconds 00000100:00100000:2.0:1789136099.179771:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136099.179801:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666839424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136099.179919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136099.183563:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839424 00000100:00100000:1.0:1789136099.183577:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839424 00000100:00100000:1.0:1789136099.183641:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136099.183651:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666839424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136099.183773:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136099.184004:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666839424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 282us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.184013:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136099.184076:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666839424:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789136099.688165:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789136099.688172:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789136099.688176:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136099.688223:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1789136099.688228:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789136099.688236:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a6c3a2e000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136099.688261:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3d92d00 x1876044666839680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136099.688279:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136099.688284:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136099.688287:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136099.688290:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136099.688314:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136099.688318:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136099.688320:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136099.688324:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136099.688357:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666839808:0@lo:400:kworker.0 00000100:00100000:3.0:1789136099.688429:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136099.688502:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136099.688509:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666839936:0@lo:400:kworker.0 00000100:00100000:3.0:1789136099.688531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136099.688566:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839808 00000100:00100000:3.0:1789136099.688573:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839808 00000100:00100000:3.0:1789136099.688633:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839936 00000100:00100000:3.0:1789136099.688637:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839936 00000100:00100000:3.0:1789136099.688654:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136099.688662:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666839808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136099.688752:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666839808:12345-0@lo:400:kworker.0 Request processed in 89us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136099.688760:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136099.688776:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136099.688783:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666839936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136099.688811:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666839936:12345-0@lo:400:kworker.0 Request processed in 29us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136099.688817:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789136099.688881:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6c3d93480 x1876044666839936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136099.688896:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666839936:0@lo:400:kworker.0 00010000:00080000:3.0:1789136099.688909:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6c3d903c0 x1876044666839808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136099.688917:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666839808:0@lo:400:kworker.0 00000100:00100000:0.0:1789136099.689038:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136099.689048:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666839552:0@lo:400:kworker.0 00000100:00100000:0.0:1789136099.689090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136099.689374:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666839680:0@lo:38:kworker.0 00000100:00100000:1.0:1789136099.689418:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789136099.689477:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136099.689575:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839680 00000100:00100000:0.0:1789136099.689581:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839680 00000100:00100000:0.0:1789136099.689616:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136099.689622:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666839680:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789136099.689652:0:17759:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:0.0:1789136099.689713:0:17759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3d6b 00000004:00100000:0.0:1789136099.689730:0:17759:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789136099.689736:0:17759:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789136099.690419:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666839552 00000100:00100000:2.0:1789136099.690437:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666839552 00000100:00100000:2.0:1789136099.690480:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789136099.690488:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:3638:x1876044666839552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136099.690554:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:3638:x1876044666839552:12345-0@lo:400:kworker.0 Request processed in 66us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136099.690561:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789136099.690612:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666839552:0@lo:400:kworker.0 00000100:00080000:1.0:1789136099.713809:0:17759:0:(import.c:65:import_set_state_nolock()) ffff90a7f08dc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136099.714595:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666839680:12345-0@lo:38:kworker.0 Request processed in 24300us (24504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.714608:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136099.714783:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136099.714794:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789136099.714803:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789136099.714808:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789136099.714811:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789136099.714835:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000519b821f): req@ffff90a6c3e3e940 x1876044666832640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136099.714874:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666839680:0@lo:38:kworker.0 00000100:00100000:0.0:1789136099.714968:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136099.715004:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646600 going to sleep for 11 seconds 00000100:00100000:1.0:1789136099.719174:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666832640 00000100:00100000:1.0:1789136099.719184:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666832640 00000100:00100000:1.0:1789136099.719242:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136099.719253:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17797:x1876044666832640:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136099.719383:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17797:x1876044666832640:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 133us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.719393:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136099.719417:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136099.719431:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666840064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136099.719471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136099.719548:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17797:1876044666832640:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789136099.719588:0:17797:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789136099.719620:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17797:1876044666840192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136099.719652:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136099.719669:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136099.719683:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840064 00000100:00100000:1.0:1789136099.719698:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840064 00000100:00100000:1.0:1789136099.719714:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840192 00000100:00100000:1.0:1789136099.719716:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840192 00000100:00100000:1.0:1789136099.719726:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136099.719731:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666840064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136099.719769:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136099.719808:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666840064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.719816:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136099.719829:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136099.719835:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17797:x1876044666840192:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136099.719993:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17797:x1876044666840192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 157us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.720000:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136099.720032:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666840064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136099.720057:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17797:1876044666840192:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136099.720125:0:17797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17797:1876044666840320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136099.720150:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136099.720165:0:17797:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136099.720178:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840320 00000100:00100000:1.0:1789136099.720182:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840320 00000100:00100000:1.0:1789136099.720199:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136099.720205:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17797:x1876044666840320:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136099.720259:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17797:x1876044666840320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136099.720265:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136099.720287:0:17797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17797:1876044666840320:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789136099.720324:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136099.722417:0:17797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136099.722521:0:17797:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1789136099.722526:0:17797:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1789136100.198152:0:18760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789136100.720510:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136100.971290:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789136101.381425:0:18812:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136101.381938:0:18812:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136101.737021:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789136102.503213:0:18863:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136102.503417:0:18863:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789136102.761953:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789136103.570258:0:18911:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4e751f10 20000000:00000080:2.0:1789136103.570280:0:18911:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7c4e3b000 uarg=0000000000000000 20000000:01000000:2.0:1789136103.570326:0:18911:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789136103.570334:0:18911:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789136103.570339:0:18911:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789136103.571632:0:18912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:1.0:1789136103.571913:0:18911:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789136103.588519:0:18911:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789136103.591441:0:18911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.591465:0:18911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.591473:0:18911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.591480:0:18911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.591525:0:18911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.591541:0:18911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 17 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136103.591571:0:18911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18911:1876044666840448:0@lo:104: 00000100:00100000:2.0:1789136103.591668:0:18911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136103.591732:0:18911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.591741:0:18911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 17 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136103.591750:0:18911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18911:1876044666840576:0@lo:104: 00000100:00100000:2.0:1789136103.591771:0:18911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136103.591788:0:18911:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce8476c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136103.592485:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840448 00000100:00100000:1.0:1789136103.592495:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840448 00000100:00100000:1.0:1789136103.592536:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840576 00000100:00100000:1.0:1789136103.592539:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840576 00000100:00100000:1.0:1789136103.592555:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136103.592563:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:18911:x1876044666840448:12345-0@lo:104: 00010000:00010000:1.0:1789136103.592578:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136103.592722:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136103.592730:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:18911:x1876044666840448:12345-0@lo:104: Request processed in 168us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136103.592737:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136103.592757:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136103.592763:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+3:18911:x1876044666840576:12345-0@lo:104: 00010000:00010000:1.0:1789136103.592772:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136103.592936:0:18911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18911:1876044666840448:0@lo:104: 00000100:00100000:2.0:1789136103.592945:0:18911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18911:1876044666840576:0@lo:104: 00010000:00010000:2.0:1789136103.592965:0:18911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595364:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136103.595379:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595411:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136103.595415:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595425:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136103.595432:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136103.595436:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136103.595494:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595501:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136103.595531:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595538:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3d17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d1e expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595551:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789136103.595554:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666840704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136103.595555:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595560:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136103.595563:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595579:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136103.595585:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136103.595590:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136103.595609:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595614:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789136103.595640:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136103.595642:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595648:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3c14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3c1b expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136103.595661:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136103.595663:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136103.595665:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136103.595675:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666840832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136103.595704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136103.595733:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840704 00000100:00100000:2.0:1789136103.595740:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840704 00010000:00010000:2.0:1789136103.595770:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 18 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136103.595805:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840832 00000100:00100000:2.0:1789136103.595809:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840832 00010000:00010000:2.0:1789136103.595821:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 19 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136103.595847:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136103.595881:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+19:3639:x1876044666840704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136103.595896:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136103.595902:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 19 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.595913:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 19 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.595927:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de3d1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3d17 expref: 19 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.595939:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136103.595974:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+18:3639:x1876044666840704:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136103.595981:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136103.595998:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136103.596004:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+17:3640:x1876044666840832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136103.596012:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136103.596015:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 17 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596025:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 17 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596035:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caee00/0x559c8745c6de3c1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3c14 expref: 17 pid: 17746 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596057:0:17740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596065:0:17740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596081:0:17740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596088:0:17740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596094:0:17740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596100:0:17740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596105:0:17740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136103.596109:0:17740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596117:0:17740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596130:0:17740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596140:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136103.596165:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+16:3640:x1876044666840832:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136103.596177:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136103.596209:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666840704:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136103.596240:0:18911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596248:0:18911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.596254:0:18911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de3d72 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136103.603076:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136103.604211:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666840832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136103.606515:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789136103.606532:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+3:18911:x1876044666840576:12345-0@lo:104: Request processed in 13764us (14755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136103.606545:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789136103.784058:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136103.784117:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136088/real 1789136088] req@ffff90a6c3e3fc00 x1876044666833920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136103.784144:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3e3fc00 x1876044666833920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136103.784153:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136088/real 1789136088] req@ffff90a6c3e3ed00 x1876044666833664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136103 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136103.784163:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3e3ed00 x1876044666833664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136103 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136103.784184:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136103.784204:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136103.784208:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833920:0@lo:8:kworker.0 00000100:00080000:2.0:1789136103.784213:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136103.784217:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789136103.784230:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666833664:0@lo:8:kworker.0 00000100:00080000:0.0:1789136103.784336:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136103.784340:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789136103.784343:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136103.784348:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:0.0:1789136103.784359:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136103.784365:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7e761e800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136103.784384:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69e83c0 x1876044666841088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136103.784397:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136103.784399:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136103.784401:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136103.784404:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 537 00000100:00080000:0.0:1789136103.784406:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136103.784409:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136103.784418:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69ead00 x1876044666841216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136103.784444:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136103.784447:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136103.784450:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136103.784453:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136103.784477:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666841600:0@lo:400:kworker.0 00000100:00100000:0.0:1789136103.784544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136103.784583:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136103.784589:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666840960:0@lo:400:kworker.0 00000100:00100000:1.0:1789136103.784611:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666841600 00000100:00100000:0.0:1789136103.784627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136103.784633:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666841600 00000100:00100000:0.0:1789136103.784653:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789136103.784677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136103.784703:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136103.784709:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666841472:0@lo:400:kworker.0 00000100:00100000:0.0:1789136103.784735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136103.784755:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666841344 00000100:00100000:1.0:1789136103.784759:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666841344 00000100:00100000:0.0:1789136103.784768:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136103.784837:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666841600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136103.784900:0:17754:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789136103.784907:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666841600:12345-0@lo:400:kworker.0 Request processed in 131us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136103.784909:0:17754:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789136103.784915:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136103.784924:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666840960 00000100:00100000:1.0:1789136103.784927:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666840960 00000100:00100000:0.0:1789136103.784934:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136103.784940:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136103.784943:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666841472 00000100:00100000:1.0:1789136103.784945:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666841472 00000100:00100000:1.0:1789136103.784956:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136103.784962:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666840960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136103.784970:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666841344:12345-0@lo:400:kworker.0 Request processed in 31us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136103.784977:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136103.784994:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666840960:12345-0@lo:400:kworker.0 Request processed in 32us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136103.784999:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789136103.785005:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c69eb480 x1876044666841344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136103.785009:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136103.785015:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666841472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136103.785018:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789136103.785034:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666841088:0@lo:8:kworker.0 00000100:00100000:1.0:1789136103.785042:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666841472:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136103.785047:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000400:00000100:0.0:1789136103.785051:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666841088 offset 0 length 520: 4 00000100:00100000:0.0:1789136103.785079:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666841216:0@lo:8:kworker.0 00000400:00000100:0.0:1789136103.785096:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666841216 offset 0 length 520: 4 00000100:00100000:0.0:1789136103.785122:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666841472:0@lo:400:kworker.0 00000100:00100000:2.0:1789136103.785220:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666840960:0@lo:400:kworker.0 00010000:00080000:2.0:1789136103.785234:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c69e8f00 x1876044666841600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136103.785243:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666841600:0@lo:400:kworker.0 00000100:00100000:0.0:1789136104.297519:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136104.297738:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136104.301180:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666841728 00000100:00100000:1.0:1789136104.301195:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666841728 00000100:00100000:1.0:1789136104.301261:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136104.301270:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666841728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136104.301428:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136104.301531:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666841728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 261us (3792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136104.301539:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136104.302116:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136104.813166:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136094/real 1789136094] req@ffff90a6c3d91a40 x1876044666835840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136104.813199:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3d91a40 x1876044666835840/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136104.813212:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136094/real 1789136094] req@ffff90a6c3e3c780 x1876044666835584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136104.813225:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6c3e3c780 x1876044666835584/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136104.813246:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136104.813261:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136104.813265:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666835840:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789136104.813287:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136104.813294:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136104.813297:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666835584:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789136104.813340:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666841856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136104.813407:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136104.813459:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666841856 00000100:00100000:0.0:1789136104.813467:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666841856 00000100:00100000:0.0:1789136104.813511:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136104.813520:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666841856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136104.813554:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136104.813614:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666841856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136104.813622:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136104.813693:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666841856:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789136104.813728:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136104.813733:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136104.813736:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136104.813739:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136104.813749:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666841984:0@lo:400:kworker.0 00000100:00100000:0.0:1789136104.813782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136104.813828:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666841984 00000100:00100000:0.0:1789136104.813832:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666841984 00000100:00100000:0.0:1789136104.813905:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789136104.813913:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+16:3639:x1876044666841984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136104.813949:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+16:3639:x1876044666841984:12345-0@lo:400:kworker.0 Request processed in 38us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136104.813956:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789136104.813994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666841984:0@lo:400:kworker.0 00000100:00080000:0.0:1789136104.814604:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136104.814609:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789136104.814612:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136104.814619:0:16093:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1789136104.814623:0:16093:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136104.814629:0:16093:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a6c44be000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136104.814656:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69e8f00 x1876044666842240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136104.814674:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136104.814684:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136104.814686:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136104.814690:0:16093:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1789136104.814693:0:16093:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136104.814697:0:16093:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136104.814712:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666842240:0@lo:8:kworker.0 00000400:00000100:0.0:1789136104.814764:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666842240 offset 0 length 520: 4 00000100:00100000:0.0:1789136104.814815:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69ea1c0 x1876044666842368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136104.814836:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666842368:0@lo:8:kworker.0 00000400:00000100:0.0:1789136104.814885:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666842368 offset 0 length 520: 4 00000100:00100000:1.0:1789136104.815374:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666842496:0@lo:400:kworker.0 00000100:00100000:1.0:1789136104.815421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136104.815454:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136104.815460:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666842112:0@lo:400:kworker.0 00000100:00100000:1.0:1789136104.815484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136104.815512:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666842496 00000100:00100000:1.0:1789136104.815518:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666842496 00000100:00100000:1.0:1789136104.815554:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666842112 00000100:00100000:1.0:1789136104.815557:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666842112 00000100:00100000:1.0:1789136104.815578:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136104.815586:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666842496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136104.815645:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666842496:12345-0@lo:400:kworker.0 Request processed in 59us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136104.815665:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136104.815685:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136104.815692:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666842112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136104.815722:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666842112:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136104.815728:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789136104.815763:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c69eb480 x1876044666842112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136104.815776:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666842112:0@lo:400:kworker.0 00010000:00080000:1.0:1789136104.815788:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6c3ce92c0 x1876044666842496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136104.815796:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666842496:0@lo:400:kworker.0 00010000:00010000:3.0:1789136104.817247:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789136105.192003:0:17750:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789136105.192013:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c3dd6000 from 19 10000000:01000000:0.0:1789136105.192020:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789136105.192071:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136105.192083:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136105.192095:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136105.192123:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666842624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789136105.192194:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136105.192249:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136105.192361:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666842624 00000100:00100000:1.0:1789136105.192379:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666842624 00000100:00100000:1.0:1789136105.192433:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136105.192443:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+16:17750:x1876044666842624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136105.192456:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136105.192469:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d79 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136105.192494:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136105.192504:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 17 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136105.192513:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879000, rc 0) 00000100:00100000:1.0:1789136105.192563:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666842624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136105.192569:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789136105.192695:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666842624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136105.192713:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136105.192735:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136105.192812:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666842752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136105.192842:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136105.192885:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881480 going to sleep for 11 seconds 00000100:00100000:1.0:1789136105.193001:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666842752 00000100:00100000:1.0:1789136105.193006:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666842752 00000100:00100000:1.0:1789136105.193037:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136105.193045:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666842752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136105.193166:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666842752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136105.193173:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136105.193203:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666842752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136105.193232:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666842880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136105.193285:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136105.193310:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7323a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136105.193321:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666842880 00000100:00100000:1.0:1789136105.193325:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666842880 00000100:00100000:1.0:1789136105.193342:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136105.193347:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666842880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136105.193430:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666842880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136105.193437:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136105.193474:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666842880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789136105.195250:0:18962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789136105.197154:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789136105.197198:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136105.197208:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136105.197220:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136105.197231:0:17750:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789136105.197234:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d8b2f000 from 19 10000000:01000000:0.0:1789136105.197236:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789136105.197280:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136105.197288:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136105.197300:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136105.197324:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666843008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789136105.197394:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136105.197448:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa450900 going to sleep for 11 seconds 00000100:00100000:1.0:1789136105.198236:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843008 00000100:00100000:1.0:1789136105.198245:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843008 00000100:00100000:1.0:1789136105.198303:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789136105.198312:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+17:17750:x1876044666843008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136105.198327:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136105.198342:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3d87 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136105.198368:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 18 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136105.198379:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 18 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136105.198389:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879e00, rc 0) 00000100:00100000:1.0:1789136105.198443:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666843008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136105.198451:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789136105.198636:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cead00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666843008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136105.198662:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136105.198672:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136105.198742:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666843136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136105.198775:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136105.198812:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce847480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136105.199000:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843136 00000100:00100000:0.0:1789136105.199006:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843136 00000100:00100000:0.0:1789136105.199040:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789136105.199046:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666843136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136105.199161:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666843136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136105.199168:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789136105.199275:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666843136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136105.199307:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666843264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136105.199348:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136105.199366:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce847480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136105.199468:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843264 00000100:00100000:0.0:1789136105.199478:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843264 00000100:00100000:0.0:1789136105.199508:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136105.199514:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666843264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136105.199606:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:17750:x1876044666843264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136105.199613:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136105.199662:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666843264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136105.200709:0:18963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789136105.200779:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789136105.200801:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136105.200810:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136105.201071:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136105.832804:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789136105.835821:0:18489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1789136106.601525:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136106.856249:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136107.884659:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136108.907158:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136109.425510:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666843392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136109.425644:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136109.425703:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843392 00000100:00100000:1.0:1789136109.425711:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843392 00000100:00100000:1.0:1789136109.425768:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136109.425778:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666843392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136109.425817:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136109.425888:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666843392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136109.425896:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136109.425943:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666843392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789136109.928790:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136109.928996:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666843520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136109.929064:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789136109.929165:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136109.929169:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136109.929172:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136109.929174:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136109.930412:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136109.930428:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666843904:0@lo:400:kworker.0 00000100:00100000:0.0:1789136109.930480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136109.930546:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843520 00000100:00100000:0.0:1789136109.930553:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843520 00000100:00100000:0.0:1789136109.930595:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843904 00000100:00100000:0.0:1789136109.930599:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843904 00000100:00100000:0.0:1789136109.930612:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136109.930619:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666843520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136109.930654:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136109.930742:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666843520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136109.930750:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136109.930767:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136109.930773:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666843904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136109.930803:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666843904:12345-0@lo:400:kworker.0 Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136109.930809:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136109.930847:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666843904:0@lo:400:kworker.0 00000100:00100000:0.0:1789136109.930883:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666843520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136109.931927:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666843648:0@lo:400:kworker.0 00000100:00100000:3.0:1789136109.931997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136109.932036:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136109.932043:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666843776:0@lo:400:kworker.0 00000100:00100000:3.0:1789136109.932067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136109.932166:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843648 00000100:00100000:0.0:1789136109.932171:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843648 00000100:00100000:0.0:1789136109.932463:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789136109.932472:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:3640:x1876044666843648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136109.932532:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:3640:x1876044666843648:12345-0@lo:400:kworker.0 Request processed in 62us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136109.932539:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789136109.932586:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666843648:0@lo:400:kworker.0 00000100:00080000:1.0:1789136109.932715:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136109.932721:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136109.932723:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136109.932727:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136109.932775:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666844032:0@lo:400:kworker.0 00000100:00100000:0.0:1789136109.932804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136109.934469:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666843776 00000100:00100000:3.0:1789136109.934480:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666843776 00000100:00100000:3.0:1789136109.934535:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844032 00000100:00100000:3.0:1789136109.934539:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844032 00000100:00100000:3.0:1789136109.934650:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136109.934661:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666843776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136109.934733:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666843776:12345-0@lo:400:kworker.0 Request processed in 73us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136109.934740:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136109.934756:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136109.934762:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666844032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136109.934794:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666844032:12345-0@lo:400:kworker.0 Request processed in 32us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136109.934811:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789136109.935039:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6c3ff70c0 x1876044666843776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136109.935056:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666843776:0@lo:400:kworker.0 00010000:00080000:0.0:1789136109.935087:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c69eb480 x1876044666844032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136109.935097:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666844032:0@lo:400:kworker.0 00000040:00080000:3.0:1789136110.185665:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136110.952224:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136111.942073:0:19260:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136111.942078:0:19260:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789136111.942079:0:19260:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789136111.942191:0:19260:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a6c44ff800 00000020:01000004:3.0:1789136111.942208:0:19260:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789136111.942222:0:19260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789136111.942235:0:19260:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a7d1848000) 00000020:00000080:3.0:1789136111.942253:0:19260:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1789136111.980840:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789136112.048799:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789136112.059519:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789136112.059839:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789136112.060308:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789136112.061316:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789136112.061731:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789136112.061983:0:19260:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1789136112.064812:0:19260:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789136112.065149:0:19260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789136112.065163:0:19260:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789136112.065177:0:19260:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x559c8745c6de3d9c 00000020:01000004:0.0:1789136112.065185:0:19260:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789136112.065208:0:19260:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789136112.065211:0:19260:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789136112.065218:0:19260:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789136112.065223:0:19260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789136112.065234:0:19260:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a7efa1ced8) 00000020:00000080:0.0:1789136112.065246:0:19260:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789136112.072238:0:19260:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136112.072552:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789136112.072558:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789136112.082402:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136112.082422:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789136112.084621:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789136112.084632:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789136112.087112:0:19260:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136112.087785:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136112.087801:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789136112.094557:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789136112.094571:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789136112.114632:0:19260:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136112.115233:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789136112.115241:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789136112.117190:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136112.117204:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789136112.118497:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136112.118510:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789136112.121277:0:19260:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136112.121569:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136112.121575:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789136112.122398:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789136112.122406:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789136112.171272:0:19260:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136112.171594:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789136112.171673:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789136112.173129:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789136112.173139:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789136112.173686:0:19260:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789136112.173783:0:19260:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789136112.173790:0:19260:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789136112.185217:0:19260:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136112.185283:0:19260:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789136112.185287:0:19260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136112.185289:0:19260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136112.185290:0:19260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136112.185291:0:19260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136112.185362:0:19260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136112.185365:0:19260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136112.185366:0:19260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136112.185368:0:19260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136112.185370:0:19260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136112.185374:0:19260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789136112.185376:0:19260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136112.185377:0:19260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136112.185378:0:19260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136112.185379:0:19260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136112.185380:0:19260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136112.185381:0:19260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136112.185382:0:19260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136112.185383:0:19260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136112.185384:0:19260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136112.185412:0:19260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789136112.185441:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136112.185526:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.185651:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.185801:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844160 00000100:00100000:1.0:1789136112.185809:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844160 00000100:00100000:1.0:1789136112.186000:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789136112.186011:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:19260:x1876044666844160:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789136112.186041:0:17747:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789136112.186044:0:17747:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789136112.186048:0:17747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789136112.186626:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:19260:x1876044666844160:12345-0@lo:253:mount.lustre.0 Request processed in 615us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.186636:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789136112.186836:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136112.186848:0:19260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789136112.186851:0:19260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136112.186879:0:19260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136112.186881:0:19260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136112.186882:0:19260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136112.186883:0:19260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136112.186884:0:19260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136112.186885:0:19260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136112.186887:0:19260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136112.186888:0:19260:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136112.186908:0:19260:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a6c44ff800 from lustre-OST0000 10000000:01000000:2.0:1789136112.186939:0:19260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789136112.186942:0:19260:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789136112.186950:0:19260:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a6c2b94ed8 local copy 00010000:00010000:2.0:1789136112.186961:0:19260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136112.187079:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136112.187114:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.187309:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.187487:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844288 00000100:00100000:1.0:1789136112.187492:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844288 00000100:00100000:1.0:1789136112.187561:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789136112.187571:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:19260:x1876044666844288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136112.187650:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+18:19260:x1876044666844288:12345-0@lo:501:mount.lustre.0 Request processed in 81us (535us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789136112.187656:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789136112.187722:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844288:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789136112.187735:0:19260:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789136112.187753:0:19260:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789136112.187759:0:19260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.187779:0:19260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136112.187804:0:19260:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a6c44ff800 10000000:01000000:2.0:1789136112.187808:0:19260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789136112.187813:0:19260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789136112.187816:0:19260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136112.187820:0:19260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789136112.187822:0:19260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789136112.187842:0:19260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.187849:0:19260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.187873:0:19260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136112.187886:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136112.187909:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.188115:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136112.188230:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844416 00000100:00100000:0.0:1789136112.188234:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844416 00000100:00100000:0.0:1789136112.188258:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789136112.188263:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+18:19260:x1876044666844416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136112.188271:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136112.188283:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c2d3e600/0x559c8745c6de3db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3daa expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.188319:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c2d3e600/0x559c8745c6de3db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3daa expref: 19 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.188330:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c2d3e600/0x559c8745c6de3db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3daa expref: 19 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.188338:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c2d3e600, rc 0) 00000100:00100000:0.0:1789136112.188520:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844416:12345-0@lo:101:mount.lustre.0 Request processed in 255us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.188527:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789136112.188808:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136112.188821:0:19260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.188830:0:19260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136112.190000:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789136112.190572:0:19260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136112.194127:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789136112.194173:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789136112.194181:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789136112.194189:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789136112.194196:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789136112.194203:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789136112.194217:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789136112.194221:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789136112.194515:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136112.194589:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.194718:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44780 going to sleep for 11 seconds 00000100:00100000:0.0:1789136112.195179:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844544 00000100:00100000:0.0:1789136112.195189:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844544 00000100:00100000:0.0:1789136112.195235:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789136112.195244:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136112.195749:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844544:12345-0@lo:501:mount.lustre.0 Request processed in 503us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.195759:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789136112.195962:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136112.196099:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136112.196145:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136112.196225:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.196260:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844672 00000100:00100000:1.0:1789136112.196265:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844672 00000100:00100000:1.0:1789136112.196505:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789136112.196515:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136112.197611:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844672:12345-0@lo:503:mount.lustre.0 Request processed in 1085us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.197622:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136112.197962:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136112.198781:0:19260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136112.198910:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136112.198977:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136112.199085:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.199208:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844800 00000100:00100000:1.0:1789136112.199221:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844800 00000100:00100000:1.0:1789136112.199270:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789136112.199279:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.199950:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844800:12345-0@lo:502:mount.lustre.0 Request processed in 669us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.199958:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136112.200130:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136112.200379:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789136112.200412:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789136112.200427:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789136112.200440:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789136112.200483:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789136112.200501:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789136112.200514:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789136112.200527:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789136112.200553:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789136112.200567:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789136112.200580:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789136112.200592:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789136112.206223:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136112.206332:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136112.206386:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136112.206454:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666844928 00000100:00100000:2.0:1789136112.206489:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666844928 00000100:00100000:2.0:1789136112.206539:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789136112.206548:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136112.206687:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666844928:12345-0@lo:502:mount.lustre.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136112.206706:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136112.207492:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666844928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136112.207587:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789136112.207611:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789136112.209108:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136112.209119:0:19277:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789136112.209126:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.209129:0:19277:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789136112.209134:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136112.209150:0:19277:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a7d1849a48) 00000020:00000080:3.0:1789136112.209177:0:19277:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789136112.209184:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789136112.209286:0:19277:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c44ff800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789136112.209393:0:19277:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789136112.209406:0:19277:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x559c8745c6de3dbf 00010000:00010000:3.0:1789136112.216579:0:19277:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789136112.217814:0:19277:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789136112.221532:0:19277:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789136112.224470:0:19277:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789136112.224485:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136112.224491:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.224493:0:19277:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789136112.224497:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789136112.224499:0:19277:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789136112.224508:0:19277:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136112.224510:0:19277:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136112.224512:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789136112.224514:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.224516:0:19277:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789136112.224518:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136112.224522:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.224523:0:19277:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789136112.224526:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789136112.224528:0:19277:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789136112.224530:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136112.224532:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.224533:0:19277:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789136112.224535:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136112.224537:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.224538:0:19277:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789136112.224541:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789136112.224563:0:19277:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136112.224566:0:19277:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136112.224567:0:19277:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789136112.224570:0:19277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789136112.229147:0:19260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789136112.229202:0:19260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789136112.229227:0:19260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.229241:0:19260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136112.229302:0:19260:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c44ff800 from 1 10000000:01000000:2.0:1789136112.229306:0:19260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136112.229736:0:19260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.229746:0:19260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.229757:0:19260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136112.229783:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136112.229882:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.229930:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845056 00000100:00100000:2.0:1789136112.229937:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845056 00000100:00100000:2.0:1789136112.229978:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789136112.229986:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+19:19260:x1876044666845056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136112.230000:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136112.230012:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3dc6 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.230036:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 20 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.230047:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 20 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.230056:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5c00, rc 0) 00000100:00100000:2.0:1789136112.230097:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845056:12345-0@lo:101:mount.lustre.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136112.230116:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789136112.230164:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b44c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136112.230186:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136112.230202:0:19260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.230211:0:19260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136112.232833:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789136112.233770:0:19260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136112.234761:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789136112.234804:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789136112.234827:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789136112.234833:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789136112.235278:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136112.236184:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.236273:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e01d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.243003:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845184 00000100:00100000:1.0:1789136112.243019:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845184 00000100:00100000:1.0:1789136112.243074:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789136112.243084:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136112.243284:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845184:12345-0@lo:501:mount.lustre.0 Request processed in 201us (7432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.243291:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789136112.244074:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136112.244153:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136112.244212:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.244259:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.244335:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845312 00000100:00100000:1.0:1789136112.244341:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845312 00000100:00100000:1.0:1789136112.244379:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789136112.244387:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136112.244495:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845312:12345-0@lo:503:mount.lustre.0 Request processed in 108us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.244503:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789136112.244850:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845312:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789136112.245355:0:19260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789136112.245450:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136112.245524:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.245560:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.246204:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845440 00000100:00100000:1.0:1789136112.246211:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845440 00000100:00100000:1.0:1789136112.246258:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789136112.246266:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845440:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.246395:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845440:12345-0@lo:502:mount.lustre.0 Request processed in 129us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.246412:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789136112.246762:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136112.247043:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789136112.247072:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789136112.247085:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789136112.247098:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789136112.247420:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789136112.247444:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789136112.247456:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789136112.247480:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:0.0:1789136112.247493:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:0.0:1789136112.247816:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:0.0:1789136112.247834:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:0.0:1789136112.247845:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:0.0:1789136112.247992:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:0.0:1789136112.248010:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:0.0:1789136112.248020:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:0.0:1789136112.248030:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:0.0:1789136112.248040:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:0.0:1789136112.248080:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136112.248768:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.249242:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.249438:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845568 00000100:00100000:1.0:1789136112.249447:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845568 00000100:00100000:1.0:1789136112.249664:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789136112.249676:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.250275:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845568:12345-0@lo:502:mount.lustre.0 Request processed in 599us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.250283:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789136112.250443:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136112.250681:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:0.0:1789136112.250819:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789136112.252088:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136112.252099:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252102:0:19281:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789136112.252191:0:19281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c44ff800 00000020:00000080:0.0:1789136112.252195:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136112.252203:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136112.252206:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252207:0:19281:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789136112.252209:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136112.252212:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252213:0:19281:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789136112.252217:0:19281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c44ff800 00000020:00000080:0.0:1789136112.252218:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136112.252278:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136112.252281:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252283:0:19281:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789136112.252285:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136112.252287:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252289:0:19281:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136112.252588:0:19281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c44ff800 00000020:00000080:0.0:1789136112.252591:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136112.252672:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136112.252676:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252677:0:19281:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136112.252680:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136112.252682:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136112.252684:0:19281:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136112.252687:0:19281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c44ff800 00000020:00000080:1.0:1789136112.255451:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136112.255550:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136112.255555:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136112.255557:0:19281:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136112.255561:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136112.255566:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136112.255567:0:19281:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136112.255572:0:19281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c44ff800 00000020:00000080:1.0:1789136112.255575:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136112.255593:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136112.255596:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136112.255597:0:19281:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136112.255773:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136112.255777:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136112.255778:0:19281:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789136112.255782:0:19281:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c44ff800 00000020:00000080:1.0:1789136112.255784:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136112.255825:0:19281:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136112.255828:0:19281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136112.255829:0:19281:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789136112.255832:0:19281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789136112.256440:0:19260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789136112.256594:0:19260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136112.256772:0:19260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.256786:0:19260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136112.256848:0:19260:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789136112.256851:0:19260:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a6c44ff800 10000000:01000000:0.0:1789136112.256878:0:19260:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a6c44ff800 10000000:01000000:0.0:1789136112.256883:0:19260:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136112.256889:0:19260:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6c44ff800 from 1 10000000:01000000:0.0:1789136112.256892:0:19260:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789136112.256929:0:19260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.256936:0:19260:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.256946:0:19260:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136112.256969:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136112.257037:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.257092:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789136112.257492:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845696 00000100:00100000:3.0:1789136112.257500:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845696 00000100:00100000:3.0:1789136112.257557:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789136112.257568:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+20:19260:x1876044666845696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136112.257583:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136112.257596:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de3ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3dd4 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.257835:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de3ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3dd4 expref: 21 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.257848:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de3ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3dd4 expref: 21 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.257887:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf200, rc 0) 00000100:00100000:3.0:1789136112.257939:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666845696:12345-0@lo:101:mount.lustre.0 Request processed in 373us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136112.257946:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789136112.258946:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136112.258969:0:19260:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.258993:0:19260:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136112.262607:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789136112.262937:0:19260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136112.263094:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789136112.263127:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789136112.263139:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789136112.263149:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789136112.263158:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789136112.263170:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789136112.263181:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789136112.263192:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789136112.263202:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789136112.263212:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789136112.263224:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789136112.263234:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789136112.263244:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789136112.263253:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789136112.263262:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789136112.263272:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789136112.263281:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789136112.263306:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789136112.263337:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789136112.263352:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789136112.263367:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789136112.263379:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789136112.263392:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789136112.263406:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789136112.263420:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789136112.263433:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789136112.263469:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789136112.263488:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789136112.263502:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789136112.263515:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789136112.263528:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789136112.263540:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789136112.263552:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789136112.263578:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789136112.263594:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789136112.263607:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789136112.263622:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789136112.263642:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789136112.263649:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789136112.263731:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136112.263799:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.263848:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.267621:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845824 00000100:00100000:1.0:1789136112.267655:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845824 00000100:00100000:1.0:1789136112.267720:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136112.267730:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666845824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136112.267935:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666845824:12345-0@lo:501:mount.lustre.0 Request processed in 206us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.267943:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789136112.268525:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136112.268579:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136112.268648:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.269090:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.269204:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666845952 00000100:00100000:1.0:1789136112.269210:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666845952 00000100:00100000:1.0:1789136112.269251:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789136112.269259:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666845952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136112.269378:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666845952:12345-0@lo:503:mount.lustre.0 Request processed in 119us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.269385:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789136112.269480:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666845952:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136112.270030:0:19260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136112.270125:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666846080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136112.270176:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.270212:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e01d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.270741:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846080 00000100:00100000:1.0:1789136112.270750:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846080 00000100:00100000:1.0:1789136112.270811:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789136112.270820:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666846080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.270958:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666846080:12345-0@lo:502:mount.lustre.0 Request processed in 138us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.270966:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789136112.271266:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666846080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136112.271517:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789136112.271559:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789136112.271590:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789136112.271842:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789136112.271898:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789136112.271914:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789136112.271929:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789136112.271944:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789136112.271960:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789136112.271976:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789136112.271990:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789136112.272002:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789136112.272017:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789136112.272032:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789136112.272046:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789136112.272062:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789136112.272077:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789136112.272090:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789136112.278516:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789136112.278561:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789136112.278575:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789136112.278586:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789136112.280877:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789136112.280950:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789136112.280970:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789136112.280989:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789136112.281029:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789136112.281045:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789136112.281056:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789136112.281067:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789136112.281077:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789136112.281088:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789136112.281492:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789136112.281512:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789136112.281528:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789136112.281544:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789136112.281557:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789136112.281571:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789136112.281583:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789136112.281596:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789136112.281625:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789136112.281640:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789136112.281654:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789136112.281667:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789136112.281691:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789136112.281715:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789136112.281730:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789136112.281745:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789136112.281821:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666846208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.281926:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.281975:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846208 00000100:00100000:1.0:1789136112.281982:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846208 00000100:00100000:1.0:1789136112.282033:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789136112.282042:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666846208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.285068:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666846208:12345-0@lo:502:mount.lustre.0 Request processed in 3018us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.285083:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789136112.285196:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c38e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136112.285223:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666846208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136112.285573:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789136112.287949:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789136112.288023:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666846336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136112.288102:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.288156:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7cead0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136112.291908:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846336 00000100:00100000:2.0:1789136112.291923:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846336 00000100:00100000:2.0:1789136112.291987:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789136112.291998:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666846336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136112.292167:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666846336:12345-0@lo:502:mount.lustre.0 Request processed in 171us (4065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136112.292175:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789136112.292441:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666846336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136112.292537:0:19260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789136112.292552:0:19260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789136112.294879:0:19285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789136112.294896:0:19285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a7e6e9b490) 00000020:00000080:1.0:1789136112.294919:0:19285:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789136112.295007:0:19285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c44ff800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789136112.295010:0:19285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c44ff800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789136112.295013:0:19285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c44ff800 3 00010000:00080000:1.0:1789136112.295039:0:19285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7ff596800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1789136112.305496:0:19285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789136112.306845:0:19285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789136112.306892:0:19285:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789136112.306903:0:19285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x559c8745c6de3de9 00000100:00080000:1.0:1789136112.306912:0:19285:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136112.306916:0:19285:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7ff596800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136112.306947:0:19285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c86dc3c0 x1876044666846464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136112.306975:0:19285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136112.307025:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.307031:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136112.307033:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.307035:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136112.307050:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.307052:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136112.307053:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.307055:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136112.307080:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666846720:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.307132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.307159:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136112.307163:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666846592:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.307180:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.307196:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666846848:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.307210:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.307219:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136112.307222:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666846976:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.307233:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136112.307259:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846720 00000100:00100000:1.0:1789136112.307263:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846720 00000100:00100000:1.0:1789136112.307287:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846976 00000100:00100000:1.0:1789136112.307289:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846976 00000100:00100000:3.0:1789136112.307547:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136112.307558:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136112.307611:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666846720:12345-0@lo:400:kworker.0 Request processed in 55us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136112.307618:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789136112.307655:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c86df480 x1876044666846720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136112.307669:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666846720:0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.308581:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136112.308590:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666846976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136112.309048:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666846976:12345-0@lo:400:kworker.0 Request processed in 458us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.309062:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789136112.309219:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c86df0c0 x1876044666846976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136112.309231:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666846976:0@lo:400:kworker.0 00000100:00100000:0.0:1789136112.309277:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666846464:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136112.309319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.309397:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846592 00000100:00100000:0.0:1789136112.309404:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846592 00000100:00100000:0.0:1789136112.309425:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846848 00000100:00100000:0.0:1789136112.309428:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846848 00000100:00100000:0.0:1789136112.309441:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789136112.309448:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666846592:12345-0@lo:400:kworker.0 00000020:01000004:1.0:1789136112.309568:0:19285:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789136112.309582:0:19285:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90a7e6e99a48) 00000020:00000080:1.0:1789136112.309821:0:19285:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789136112.310492:0:19285:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c44ff800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789136112.310498:0:19285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c44ff800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789136112.310500:0:19285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c44ff800 3 00010000:00080000:1.0:1789136112.310527:0:19285:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7e7618800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.131@tcp at head 00000100:00100000:0.0:1789136112.311972:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666846592:12345-0@lo:400:kworker.0 Request processed in 2516us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.311992:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789136112.312024:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789136112.312034:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666846848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136112.312102:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666846848:12345-0@lo:400:kworker.0 Request processed in 71us (4890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.312107:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789136112.312137:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666846464 00000100:00100000:0.0:1789136112.312142:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666846464 00000100:00100000:0.0:1789136112.312170:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136112.312174:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666846464:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789136112.312195:0:17755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1789136112.312226:0:17755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x559c8745c6de3df7 00000004:00100000:0.0:1789136112.312239:0:17755:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789136112.312268:0:17755:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136112.312306:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876044666846464:12345-0@lo:38:llog_process_th.0 Request processed in 130us (2986us total) trans 0 rc 0/0 00010000:00010000:1.0:1789136112.315972:0:19285:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789136112.316192:0:19285:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789136112.316235:0:19285:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789136112.316248:0:19285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x559c8745c6de3dfe 00000100:00080000:1.0:1789136112.316259:0:19285:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136112.316265:0:19285:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90a7e7618800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136112.316315:0:19285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c86dde00 x1876044666847104/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136112.316331:0:19285:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789136112.316356:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.316361:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136112.316363:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.316365:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136112.316369:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.316372:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136112.316374:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136112.316384:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136112.318017:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136112.318103:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666846592:0@lo:400:kworker.0 00000100:00100000:0.0:1789136112.318141:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666846848:0@lo:400:kworker.0 00000100:00100000:0.0:1789136112.318164:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666847104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136112.318236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789136112.318302:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c86dc3c0 x1876044666846464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136112.318321:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136112.318338:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789136112.318347:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789136112.318351:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789136112.318355:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789136112.318362:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666846464:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136112.318454:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847104 00000100:00100000:1.0:1789136112.318472:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847104 00000100:00100000:1.0:1789136112.318502:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136112.318510:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666847104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136112.318538:0:18920:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:1.0:1789136112.318587:0:18920:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x559c8745c6de3e05 00000004:00100000:1.0:1789136112.318754:0:18920:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136112.318787:0:18920:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136112.318837:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876044666847104:12345-0@lo:38:llog_process_th.0 Request processed in 327us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136112.318844:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789136112.318892:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c86dde00 x1876044666847104/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136112.318900:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136112.318905:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789136112.318909:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789136112.318913:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789136112.318915:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e7618800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136112.318919:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666847104:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789136112.319027:0:19285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789136112.320257:0:19260:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789136112.320397:0:19260:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136112.320468:0:19260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136112.320489:0:19260:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136112.320542:0:19260:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136112.320544:0:19260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136112.320546:0:19260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136112.320546:0:19260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136112.320548:0:19260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136112.320549:0:19260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136112.320550:0:19260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136112.320552:0:19260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136112.320553:0:19260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136112.320557:0:19260:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789136112.320559:0:19260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136112.320560:0:19260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136112.320561:0:19260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136112.320562:0:19260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136112.320563:0:19260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136112.320564:0:19260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136112.320565:0:19260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136112.320566:0:19260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136112.320567:0:19260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136112.320590:0:19260:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789136112.320619:0:19260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666847232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136112.320697:0:19260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136112.320739:0:19260:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c381e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789136112.323850:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847232 00000100:00100000:0.0:1789136112.323876:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847232 00000100:00100000:0.0:1789136112.323945:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789136112.323955:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666847232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136112.323987:0:17747:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789136112.323999:0:17747:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789136112.361491:0:17747:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789136112.361545:0:17747:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789136112.362279:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:19260:x1876044666847232:12345-0@lo:253:mount.lustre.0 Request processed in 38320us (41576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.362301:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789136112.362521:0:19260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:19260:1876044666847232:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136112.362539:0:19260:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789136112.362543:0:19260:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136112.362545:0:19260:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789136112.362546:0:19260:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136112.362547:0:19260:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136112.362549:0:19260:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136112.362559:0:19260:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136112.362560:0:19260:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136112.362562:0:19260:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136112.362563:0:19260:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136112.362577:0:19260:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789136112.378324:0:17769:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789136112.378331:0:17769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789136112.378351:0:17769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.378366:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 20 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.378371:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 20 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.378376:0:17769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.378412:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 20 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.378430:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 20 pid: 17747 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136112.378442:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666847360:0@lo:104: 00000100:00100000:3.0:1789136112.378514:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136112.378582:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 20 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.378591:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 20 pid: 17745 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136112.378600:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666847488:0@lo:104: 00000100:00100000:3.0:1789136112.378626:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136112.378801:0:17769:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c3535540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136112.379559:0:17736:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789136112.379582:0:17736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847360 00000100:00100000:0.0:1789136112.379589:0:17736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847360 00000100:00100000:0.0:1789136112.379621:0:17736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847488 00000100:00100000:0.0:1789136112.379624:0:17736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847488 00000100:00100000:0.0:1789136112.379638:0:17736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136112.379646:0:17736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+4:17769:x1876044666847360:12345-0@lo:104: 00010000:00010000:0.0:1789136112.379660:0:17736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379737:0:17736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789136112.379743:0:17736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+4:17769:x1876044666847360:12345-0@lo:104: Request processed in 98us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.379762:0:17736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136112.379782:0:17736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136112.379788:0:17736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c7433850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666847488:12345-0@lo:104: 00010000:00010000:0.0:1789136112.379795:0:17736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379829:0:17736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789136112.379835:0:17736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c7433850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666847488:12345-0@lo:104: Request processed in 48us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.379840:0:17736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789136112.379893:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136112.379897:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379902:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136112.379905:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379910:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136112.379915:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136112.379918:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136112.379943:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379948:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136112.379967:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379972:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de3d5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d64 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379980:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136112.379982:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.379996:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136112.379998:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380002:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136112.380006:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136112.380009:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136112.380018:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380021:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136112.380024:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380028:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de3d4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d56 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380044:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136112.380045:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136112.380046:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136112.380051:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136112.380061:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666847616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136112.380084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.380112:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136112.380115:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666847744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136112.380128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136112.380152:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847616 00000100:00100000:0.0:1789136112.380155:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847616 00010000:00010000:0.0:1789136112.380166:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 21 pid: 17747 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136112.380179:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847744 00000100:00100000:0.0:1789136112.380180:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847744 00010000:00010000:0.0:1789136112.380185:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 22 pid: 17745 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136112.380192:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136112.380196:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+22:3640:x1876044666847616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136112.380203:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136112.380206:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 22 pid: 17747 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380213:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 22 pid: 17747 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380232:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136112.380251:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+22:3640:x1876044666847616:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.380256:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136112.380265:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136112.380269:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+21:3640:x1876044666847744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136112.380273:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136112.380276:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 21 pid: 17745 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380281:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 21 pid: 17745 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380289:0:17739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.380296:0:17739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380586:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de3d64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3d5d expref: 21 pid: 17747 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136112.380594:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666847360:0@lo:104: 00010000:00010000:3.0:1789136112.380604:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3f800/0x559c8745c6de3d56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3d4f expref: 20 pid: 17745 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136112.380611:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666847488:0@lo:104: 00010000:00010000:3.0:1789136112.380629:0:17769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380638:0:17769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380655:0:17769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789136112.380662:0:17769:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789136112.380664:0:17769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789136112.380674:0:17769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380683:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380700:0:17769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380713:0:17769:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.380722:0:17769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789136112.381084:0:17739:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005832025s 00010000:00010000:0.0:1789136112.381089:0:17739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381095:0:17739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381099:0:17739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381111:0:17739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381115:0:17739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136112.381117:0:17739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381122:0:17739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381130:0:17739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381134:0:17739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789136112.381140:0:17739:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005832025s 00010000:00010000:0.0:1789136112.381142:0:17739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381146:0:17739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381149:0:17739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381153:0:17739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381155:0:17739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136112.381160:0:17739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381165:0:17739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.381496:0:17769:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136112.381504:0:17769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381595:0:17739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381603:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de3e13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381614:0:17739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381619:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de3e0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136112.381629:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136112.381673:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+19:3640:x1876044666847744:12345-0@lo:103:ldlm_bl.0 Request processed in 1402us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136112.381681:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136112.381819:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666847744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136112.381828:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666847616:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789136112.382475:0:19260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789136112.384116:0:19260:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789136112.384127:0:19260:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789136112.384163:0:19260:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789136112.384207:0:19260:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789136112.384226:0:19260:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789136112.384243:0:19260:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789136112.388652:0:19260:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136112.389132:0:19260:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136113.001703:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789136113.574428:0:19343:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789136113.575747:0:19343:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136114.024744:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789136114.280802:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789136114.280809:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3dd6000 from 9 10000000:01000000:1.0:1789136114.280814:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789136114.280896:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.280925:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.280938:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136114.280963:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666847872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136114.281037:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136114.281080:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7cead0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136114.281915:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666847872 00000100:00100000:2.0:1789136114.281924:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666847872 00000100:00100000:2.0:1789136114.281988:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789136114.281999:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:17750:x1876044666847872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136114.282015:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136114.282032:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3e1a expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.282056:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 20 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.282067:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 20 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136114.282076:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4e00, rc 0) 00000100:00100000:2.0:1789136114.282140:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+20:17750:x1876044666847872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.282157:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789136114.282576:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666847872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136114.282601:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.282612:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.283054:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666848000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136114.283102:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136114.283137:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136114.283288:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848000 00000100:00100000:1.0:1789136114.283293:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848000 00000100:00100000:1.0:1789136114.283330:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789136114.283339:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+20:17750:x1876044666848000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789136114.283357:0:17747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789136114.283375:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789136114.283379:0:17747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789136114.283471:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+20:17750:x1876044666848000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.283478:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789136114.286948:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666848000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136114.287040:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136114.287052:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.287064:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136114.287074:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136114.287077:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d8b2f000 from 9 10000000:01000000:3.0:1789136114.287079:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136114.287112:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.287120:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.287129:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.287160:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666848128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136114.287215:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136114.287255:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136114.287362:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848128 00000100:00100000:1.0:1789136114.287369:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848128 00000100:00100000:1.0:1789136114.287421:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789136114.287442:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+20:17750:x1876044666848128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136114.287456:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136114.287467:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3e28 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.287501:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 21 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.287511:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 21 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136114.287520:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878400, rc 0) 00000100:00100000:1.0:1789136114.287568:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666848128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136114.287575:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789136114.287898:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666848128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136114.287913:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.287922:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136114.287965:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666848256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136114.287994:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136114.288015:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136114.289116:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848256 00000100:00100000:2.0:1789136114.289126:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848256 00000100:00100000:2.0:1789136114.289173:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789136114.289182:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666848256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136114.289214:0:17747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136114.289233:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136114.289236:0:17747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789136114.289353:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666848256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.289361:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789136114.289817:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666848256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136114.289912:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136114.289922:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136114.289931:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136114.536085:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136114.536113:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666848384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136114.536219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136114.536274:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848384 00000100:00100000:2.0:1789136114.536282:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848384 00000100:00100000:2.0:1789136114.536332:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136114.536341:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666848384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136114.536381:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789136114.536696:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666848384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 355us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136114.536704:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136114.536755:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666848384:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789136115.049956:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136115.058428:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666848512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136115.058505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136115.058601:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848512 00000100:00100000:2.0:1789136115.058609:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848512 00000100:00100000:2.0:1789136115.058691:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789136115.058711:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666848512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136115.058748:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136115.070099:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666848512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11388us (11582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136115.070115:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136115.075717:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666848512:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136116.075460:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136116.841681:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136117.096144:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136117.609388:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136117.609395:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136117.609410:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136117.609413:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136117.609445:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136117.609448:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136117.609451:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136117.609455:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136117.609494:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666848896:0@lo:400:kworker.0 00000100:00100000:0.0:1789136117.609565:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136117.609688:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666848768:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.609734:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136117.609772:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848768 00000100:00100000:2.0:1789136117.609780:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848768 00000100:00100000:2.0:1789136117.609825:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789136117.609834:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666848768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.609905:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666848768:12345-0@lo:400:kworker.0 Request processed in 72us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136117.609912:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136117.610018:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666849408:0@lo:400:kworker.0 00000100:00100000:0.0:1789136117.610044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136117.610064:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848896 00000100:00100000:0.0:1789136117.610067:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848896 00000100:00100000:0.0:1789136117.610090:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849408 00000100:00100000:0.0:1789136117.610092:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849408 00000100:00100000:0.0:1789136117.610113:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136117.610118:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666848896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.610390:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666848768:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.610400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666849280:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.610430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136117.610456:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789136117.610463:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666848640:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.610489:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136117.610513:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666849152:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.610533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136117.610556:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666848640 00000100:00100000:2.0:1789136117.610559:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666848640 00000100:00100000:2.0:1789136117.610613:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789136117.610621:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:3641:x1876044666848640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.610659:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:3641:x1876044666848640:12345-0@lo:400:kworker.0 Request processed in 40us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136117.610665:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789136117.610767:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666849024:0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.610803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136117.610839:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849280 00000100:00100000:1.0:1789136117.610842:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849280 00000100:00100000:1.0:1789136117.610888:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849152 00000100:00100000:1.0:1789136117.610891:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849152 00000100:00100000:1.0:1789136117.610903:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136117.610910:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666849408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.610943:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666849408:12345-0@lo:400:kworker.0 Request processed in 33us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136117.610949:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136117.610963:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136117.610984:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666849280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.611020:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666849280:12345-0@lo:400:kworker.0 Request processed in 53us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136117.611034:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136117.611051:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136117.611057:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666849152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.611085:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666849152:12345-0@lo:400:kworker.0 Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136117.611091:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789136117.611120:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136117.611124:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136117.611135:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849024 00000100:00100000:0.0:1789136117.611395:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666848896:12345-0@lo:400:kworker.0 Request processed in 1275us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136117.611403:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789136117.611675:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3cea1c0 x1876044666848896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136117.611687:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666848896:0@lo:400:kworker.0 00010000:00080000:2.0:1789136117.611710:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3cebc00 x1876044666849408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136117.611718:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666849408:0@lo:400:kworker.0 00000100:00100000:2.0:1789136117.611824:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666848640:0@lo:400:kworker.0 00010000:00080000:2.0:1789136117.611835:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce8f00 x1876044666849152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136117.611844:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666849152:0@lo:400:kworker.0 00010000:00080000:2.0:1789136117.611866:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce83c0 x1876044666849280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136117.611874:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666849280:0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.612317:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849024 00000100:00100000:1.0:1789136117.612372:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136117.612380:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666849024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136117.612435:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666849024:12345-0@lo:400:kworker.0 Request processed in 57us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136117.612441:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136117.612471:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666849024:0@lo:400:kworker.0 00010000:00010000:3.0:1789136118.122970:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136119.151420:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136119.470771:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136104/real 1789136104] req@ffff90a7c69ea1c0 x1876044666842368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.470806:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7c69ea1c0 x1876044666842368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.470835:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136104/real 1789136104] req@ffff90a7c69e8f00 x1876044666842240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.470850:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7c69e8f00 x1876044666842240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136119.470885:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136119.470911:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136119.470916:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666842368:0@lo:8:kworker.0 00000100:00080000:0.0:1789136119.470922:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136119.470928:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136119.470932:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666842240:0@lo:8:kworker.0 00000100:00080000:2.0:1789136119.471596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136119.471602:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136119.471605:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136119.471609:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136119.471636:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136119.471639:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789136119.471643:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136119.471648:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1789136119.471654:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789136119.471661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a6c44be000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136119.471683:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3fc00 x1876044666850048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136119.471696:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136119.471699:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789136119.471701:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136119.471704:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1789136119.471706:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789136119.471710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136119.471722:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3ed00 x1876044666850176/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136119.471765:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666849920:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.471842:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.471901:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789136119.471908:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666849536:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.471937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.471970:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666850304:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.471998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.472025:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666849664:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.472076:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666850432:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472097:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.472117:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789136119.472123:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666849792:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.472178:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666850560:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472201:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.472233:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849920 00000100:00100000:2.0:1789136119.472240:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849920 00000100:00100000:2.0:1789136119.472276:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849664 00000100:00100000:2.0:1789136119.472279:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849664 00000100:00100000:2.0:1789136119.472295:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136119.472303:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666849920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472370:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666849920:12345-0@lo:400:kworker.0 Request processed in 65us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472376:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136119.472395:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136119.472401:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666849664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472430:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666849664:12345-0@lo:400:kworker.0 Request processed in 30us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472436:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136119.472455:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849536 00000100:00100000:2.0:1789136119.472458:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849536 00000100:00100000:2.0:1789136119.472482:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789136119.472488:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:3638:x1876044666849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472526:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:3638:x1876044666849536:12345-0@lo:400:kworker.0 Request processed in 38us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472532:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789136119.472558:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850304 00000100:00100000:2.0:1789136119.472562:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850304 00000100:00100000:2.0:1789136119.472579:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850432 00000100:00100000:2.0:1789136119.472582:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850432 00000100:00100000:2.0:1789136119.472602:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666849792 00000100:00100000:2.0:1789136119.472604:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666849792 00000100:00100000:2.0:1789136119.472612:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850560 00000100:00100000:2.0:1789136119.472614:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850560 00000100:00100000:2.0:1789136119.472629:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789136119.472634:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666850304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472665:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666850304:12345-0@lo:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472670:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789136119.472681:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136119.472686:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666850432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472709:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666850432:12345-0@lo:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472715:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136119.472727:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789136119.472732:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666849792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472759:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666849792:12345-0@lo:400:kworker.0 Request processed in 27us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472765:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789136119.472775:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789136119.472789:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666850560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472816:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666850560:12345-0@lo:400:kworker.0 Request processed in 29us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.472822:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789136119.472882:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666849536:0@lo:400:kworker.0 00010000:00080000:2.0:1789136119.472894:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3c780 x1876044666850304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136119.472905:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666850304:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472917:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666849920:0@lo:400:kworker.0 00010000:00080000:2.0:1789136119.472948:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3de00 x1876044666849792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136119.472956:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666849792:0@lo:400:kworker.0 00010000:00080000:2.0:1789136119.472965:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3e940 x1876044666850560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136119.472971:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666850560:0@lo:400:kworker.0 00000100:00100000:2.0:1789136119.472979:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666849664:0@lo:400:kworker.0 00010000:00080000:2.0:1789136119.472986:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3cb40 x1876044666850432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136119.472993:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666850432:0@lo:400:kworker.0 00000100:00080000:2.0:1789136119.473013:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136119.473017:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136119.475412:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666850048:0@lo:8:kworker.0 00000100:00100000:0.0:1789136119.475491:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136119.475555:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666850176:0@lo:8:kworker.0 00000100:00100000:0.0:1789136119.475594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136119.476387:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850048 00000100:00100000:2.0:1789136119.476410:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850048 00000100:00100000:2.0:1789136119.476449:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850176 00000100:00100000:2.0:1789136119.476452:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850176 00000100:00100000:2.0:1789136119.476465:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136119.476472:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1876044666850048:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136119.476505:0:19265:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:2.0:1789136119.476537:0:19265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3e36 00002000:00100000:2.0:1789136119.476551:0:19265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90a6c2291000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789136119.476555:0:19265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789136119.476558:0:19265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136119.476968:0:19265:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789136119.476995:0:19265:0:(import.c:65:import_set_state_nolock()) ffff90a6c2293800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136119.477069:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666850048:12345-0@lo:8:kworker.0 Request processed in 596us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136119.477078:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136119.477097:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136119.477102:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1876044666850176:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789136119.477115:0:19265:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789136119.486502:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3fc00 x1876044666850048/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.486520:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136119.486532:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789136119.486544:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789136119.486550:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789136119.486554:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789136119.486574:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789136119.486581:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666850048:0@lo:8:kworker.0 00000004:00080000:0.0:1789136119.486693:0:18498:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789136119.486717:0:18498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18498:1876044666850816:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789136119.486781:0:18498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136119.486809:0:18498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e82a80 going to sleep for 11 seconds 00000004:00080000:0.0:1789136119.486824:0:18497:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789136119.486941:0:18497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 567606085790ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789136119.486947:0:18497:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789136119.487159:0:19267:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789136119.487166:0:19267:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789136119.487253:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136119.487267:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666850688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136119.487298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136119.487381:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850816 00000100:00100000:0.0:1789136119.487387:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850816 00000100:00100000:0.0:1789136119.487493:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136119.487502:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18498:x1876044666850816:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789136119.487697:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850688 00000100:00100000:0.0:1789136119.487701:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850688 00000100:00100000:0.0:1789136119.487723:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136119.487730:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1876044666850688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136119.487749:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136119.487793:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1876044666850688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136119.487800:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789136119.487832:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ceb0c0 x1876044666850688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.487849:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666850688:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789136119.487944:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136119.520892:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1876044666850176:12345-0@lo:8:kworker.0 Request processed in 43776us (45284us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136119.520913:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:0.0:1789136119.525621:0:18489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789136119.525760:0:19572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789136119.525767:0:19572:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789136119.525871:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18498:x1876044666850816:12345-0@lo:7:osp-pre-0-1.0 Request processed in 38350us (39069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136119.525882:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789136119.525931:0:18498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce83c0 x1876044666850816/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789136135 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.525946:0:18498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18498:1876044666850816:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789136119.525959:0:18498:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789136119.525996:0:18498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18498:1876044666850944:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789136119.526025:0:18498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136119.526045:0:18498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d60296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136119.526061:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666850944 00000100:00100000:0.0:1789136119.526067:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666850944 00000100:00100000:0.0:1789136119.526107:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136119.526116:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18498:x1876044666850944:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789136119.526140:0:19267:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789136119.526326:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18498:x1876044666850944:12345-0@lo:5:osp-pre-0-1.0 Request processed in 210us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136119.526344:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789136119.526373:0:18498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce83c0 x1876044666850944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136135 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.526398:0:18498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18498:1876044666850944:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789136119.526406:0:18498:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789136119.526429:0:18498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18498:1876044666851072:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789136119.526453:0:18498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136119.526469:0:18498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d60296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136119.526481:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851072 00000100:00100000:0.0:1789136119.526484:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851072 00000100:00100000:0.0:1789136119.526510:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136119.526516:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18498:x1876044666851072:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789136119.526541:0:19267:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:2.0:1789136119.527651:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136119.527661:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136119.527665:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666850176:0@lo:8:kworker.0 00000001:00080000:0.0:1789136119.580430:0:19261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789136119.580446:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789136119.580669:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:18498:x1876044666851072:12345-0@lo:5:osp-pre-0-1.0 Request processed in 54149us (54210us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789136119.580682:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789136119.580778:0:18498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce83c0 x1876044666851072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136135 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.580790:0:18498:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789136119.580797:0:18498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18498:1876044666851072:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789136119.580813:0:18498:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789136119.580888:0:18498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18498:1876044666851200:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789136119.580929:0:18498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136119.580958:0:18498:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d60296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136119.581086:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851200 00000100:00100000:1.0:1789136119.581093:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851200 00000100:00100000:1.0:1789136119.581140:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136119.581148:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18498:x1876044666851200:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789136119.581350:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18498:x1876044666851200:12345-0@lo:900:osp-pre-0-1.0 Request processed in 202us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136119.581357:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789136119.581424:0:18498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce83c0 x1876044666851200/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136135 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136119.581435:0:18498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18498:1876044666851200:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789136119.656659:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666851328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136119.656751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136119.656879:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851328 00000100:00100000:3.0:1789136119.656888:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851328 00000100:00100000:3.0:1789136119.656954:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136119.656963:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666851328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136119.657001:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789136119.668724:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666851328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11750us (11962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136119.668740:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789136119.668942:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666851328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136120.168040:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136120.168080:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666851456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136120.168177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789136120.168399:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136120.168417:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851456 00000100:00100000:1.0:1789136120.168426:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851456 00000100:00100000:1.0:1789136120.170280:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136120.170308:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666851456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136120.170361:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136120.175944:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666851456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5639us (7755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136120.175964:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136120.177680:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666851456:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789136120.425962:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789136121.155194:0:19634:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789136121.197719:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136122.218095:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789136122.239381:0:19686:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136122.240496:0:19686:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136123.240307:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789136123.478586:0:19736:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136123.478803:0:19736:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789136123.569196:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136103/real 1789136103] req@ffff90a7c69e83c0 x1876044666841088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136123.569230:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7c69e83c0 x1876044666841088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136123.569241:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136103/real 1789136103] req@ffff90a7c69ead00 x1876044666841216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136123 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136123.569251:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7c69ead00 x1876044666841216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136123 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136123.569282:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136123.569303:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136123.569307:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666841088:0@lo:8:kworker.0 00000100:00080000:1.0:1789136123.569312:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136123.569316:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136123.569319:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666841216:0@lo:8:kworker.0 00000100:00100000:0.0:1789136123.571025:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666851584:0@lo:400:kworker.0 00000100:00080000:2.0:1789136123.571043:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136123.571048:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789136123.571052:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136123.571057:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:2.0:1789136123.571061:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789136123.571068:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7e761e800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136123.571088:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7d55ade00 x1876044666851840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136123.571102:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136123.571105:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789136123.571107:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136123.571109:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 551 00000100:00080000:2.0:1789136123.571112:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789136123.571115:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136123.571126:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7d55acf00 x1876044666851968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136123.571140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789136123.571149:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136123.571152:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789136123.571154:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136123.571157:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 567 00000100:00080000:2.0:1789136123.571159:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789136123.571174:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136123.571184:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3fc00 x1876044666852480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136123.571208:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666852352:0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.571221:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666852224:0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.571246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.571272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136123.571291:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851584 00000100:00100000:2.0:1789136123.571292:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666852864:0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.571298:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851584 00000100:00100000:0.0:1789136123.571344:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789136123.571353:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:3641:x1876044666851584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.571403:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:3641:x1876044666851584:12345-0@lo:400:kworker.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136123.571411:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789136123.571444:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852352 00000100:00100000:0.0:1789136123.571448:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852352 00000100:00100000:2.0:1789136123.571499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.571531:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666851712:0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.571554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.571572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666852608:0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.571593:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.571611:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789136123.571617:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666852096:0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.571642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.571660:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666852736:0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.571663:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136123.571670:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666852352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.571679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136123.571702:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666852352:12345-0@lo:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136123.571705:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852224 00000100:00100000:0.0:1789136123.571707:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136123.571708:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852224 00000100:00100000:2.0:1789136123.571727:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851712 00000100:00100000:2.0:1789136123.571730:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851712 00010000:00080000:0.0:1789136123.571740:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3ed00 x1876044666852352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136123.571742:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789136123.571747:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666852224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.571753:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666852352:0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.571762:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666851584:0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.571782:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666852224:12345-0@lo:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136123.571787:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789136123.571807:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136123.571814:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666851712:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789136123.572129:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136123.572165:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666851712:12345-0@lo:400:kworker.0 Request processed in 217us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136123.572173:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136123.572191:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852864 00000100:00100000:2.0:1789136123.572195:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852864 00000100:00100000:2.0:1789136123.572264:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852608 00000100:00100000:2.0:1789136123.572267:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852608 00000100:00100000:2.0:1789136123.572279:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852096 00000100:00100000:2.0:1789136123.572281:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852096 00000100:00100000:2.0:1789136123.572289:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852736 00000100:00100000:2.0:1789136123.572291:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852736 00000100:00100000:0.0:1789136123.572443:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666851712:0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.576148:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136123.576171:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666852864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.576294:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666852864:12345-0@lo:400:kworker.0 Request processed in 134us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136123.576302:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136123.576328:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136123.576335:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666852608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.576370:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666852608:12345-0@lo:400:kworker.0 Request processed in 37us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136123.576376:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136123.576387:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789136123.576393:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.576419:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666852096:12345-0@lo:400:kworker.0 Request processed in 27us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136123.576426:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789136123.576473:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55acb40 x1876044666852096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136123.576605:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666852096:0@lo:400:kworker.0 00010000:00080000:0.0:1789136123.576622:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3cb40 x1876044666852608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136123.576631:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666852608:0@lo:400:kworker.0 00000100:00100000:0.0:1789136123.576664:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666851840:0@lo:8:kworker.0 00000100:00100000:0.0:1789136123.576711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136123.576748:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666851968:0@lo:8:kworker.0 00000100:00100000:0.0:1789136123.576769:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136123.576786:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666852480:0@lo:8:kworker.0 00000100:00100000:0.0:1789136123.576806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136123.576834:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851840 00000100:00100000:0.0:1789136123.576840:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851840 00000100:00100000:0.0:1789136123.576885:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666851968 00000100:00100000:0.0:1789136123.576888:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666851968 00000100:00100000:0.0:1789136123.576895:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852480 00000100:00100000:0.0:1789136123.576897:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852480 00000100:00100000:0.0:1789136123.576904:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136123.576909:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666851840:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789136123.576933:0:19572:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:0.0:1789136123.576962:0:19572:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3e3d 00002000:00100000:0.0:1789136123.576975:0:19572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a6c3ba4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789136123.576980:0:19572:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789136123.576982:0:19572:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789136123.577051:0:19572:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789136123.577075:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136123.577112:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666851840:12345-0@lo:8:kworker.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136123.577119:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136123.577133:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136123.577136:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666851968:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789136123.577148:0:19572:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1789136123.580364:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136123.580376:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136123.580635:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136123.580651:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666852736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.580747:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666852736:12345-0@lo:400:kworker.0 Request processed in 102us (9065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136123.580756:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136123.580815:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666852224:0@lo:400:kworker.0 00010000:00080000:2.0:1789136123.580835:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3e940 x1876044666852864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136123.580847:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666852864:0@lo:400:kworker.0 00000100:00100000:2.0:1789136123.580905:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136123.580911:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666852480:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789136123.580930:0:19267:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136123.580965:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666852480:12345-0@lo:8:kworker.0 Request processed in 53us (4158us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136123.580981:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789136123.588067:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7d55ade00 x1876044666851840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136123.588085:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136123.588096:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789136123.588106:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789136123.588112:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789136123.588116:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789136123.588150:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789136123.588156:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666851840:0@lo:8:kworker.0 00000100:00080000:1.0:1789136123.588177:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136123.588181:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136123.588185:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666852480:0@lo:8:kworker.0 00000004:00080000:2.0:1789136123.588372:0:17778:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789136123.588395:0:17778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17778:1876044666853120:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136123.588461:0:17778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.588489:0:17778:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c381ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136123.588501:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136123.588514:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666852992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136123.588540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.588569:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853120 00000100:00100000:2.0:1789136123.588575:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853120 00000100:00100000:2.0:1789136123.588629:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136123.588637:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17778:x1876044666853120:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1789136123.588902:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789136123.597713:0:19267:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789136123.597731:0:19267:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789136123.597740:0:19267:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:1.0:1789136123.603444:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666852992 00000100:00100000:1.0:1789136123.603458:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666852992 00000100:00100000:1.0:1789136123.603519:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136123.603530:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666852992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136123.603563:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136123.603644:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1876044666852992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (15102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136123.603651:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:1.0:1789136123.603680:0:17777:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789136123.603774:0:17777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 571722918700ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789136123.603780:0:17777:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:1.0:1789136123.603836:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3cf00 x1876044666852736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136123.603886:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666852736:0@lo:400:kworker.0 00010000:00080000:2.0:1789136123.604091:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f660b0c0 x1876044666852992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136123.604105:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666852992:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1789136123.623797:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136123.623813:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623833:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1789136123.623838:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136123.623845:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623885:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623910:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623918:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623936:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136123.623948:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136123.623954:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623961:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.623966:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623975:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623991:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.623998:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.624017:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.624024:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.624026:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789136123.625605:0:17733:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789136123.626692:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136123.626704:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.626723:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1789136123.626728:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136123.626734:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.626748:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.626757:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.626765:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.626786:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136123.629603:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136123.629619:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.629634:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136123.629640:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.629653:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.629686:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.629695:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8aab05/0x559c8745c6de3e4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.629725:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.629727:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.629729:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136123.629827:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666851968:12345-0@lo:8:kworker.0 Request processed in 52685us (53053us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136123.629838:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789136123.630404:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136123.630411:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136123.630416:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666851968:0@lo:8:kworker.0 00002000:00010000:3.0:1789136123.630476:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.630485:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.630498:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.630504:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.630511:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.630526:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.630536:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.630553:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.630576:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136123.631336:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.631343:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.631354:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.631358:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.631363:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.631373:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.631381:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.631389:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.631407:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789136123.631941:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136123.631949:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.631972:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.631976:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.631986:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632003:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632010:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de3e52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632025:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136123.632028:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632035:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.632038:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632045:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632053:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632067:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de3e59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.632080:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.632081:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.632083:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.632678:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136123.636424:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136123.636440:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.636459:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1789136123.636464:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136123.636472:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.636487:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.636499:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.636507:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.636535:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136123.636925:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136123.636934:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.636949:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136123.636954:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.636965:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.636986:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.636995:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6196c1b/0x559c8745c6de3e60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.637013:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136123.637015:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136123.637017:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136123.637291:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136123.637301:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.637311:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1789136123.637315:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136123.637320:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.637330:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.637339:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.637347:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.637370:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136123.637415:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136123.637422:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.637444:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136123.637447:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.637456:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.637468:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.637476:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008107a8d0/0x559c8745c6de3e67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.637505:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.637507:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.637508:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.638302:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.638312:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638325:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.638330:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.638336:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638347:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638365:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638372:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638395:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136123.638428:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136123.638435:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.638445:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.638449:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.638458:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.638481:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.638505:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c7d66cf/0x559c8745c6de3e6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.638523:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.638525:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.638528:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.638948:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.638955:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638965:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.638969:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.638973:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638982:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638990:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.638998:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639189:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136123.639216:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136123.639222:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.639232:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136123.639236:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.639247:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.639280:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.639288:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de3e75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.639305:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.639307:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.639309:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.639479:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.639594:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639603:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.639607:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.639611:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639621:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639628:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639635:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639651:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136123.639926:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.639933:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639941:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.639950:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.639954:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639963:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639971:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.639978:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.640003:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789136123.640622:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.640629:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.640638:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.640642:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.640646:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.640655:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.640664:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.640678:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.640687:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789136123.640948:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136123.640955:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.640963:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.640968:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.640977:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.640994:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641002:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000909b807d/0x559c8745c6de3e7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641052:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136123.641057:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641064:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.641067:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641075:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641087:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641094:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c254fd19/0x559c8745c6de3e83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641105:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136123.641109:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641115:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.641118:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641136:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641146:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641153:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070897592/0x559c8745c6de3e8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.641166:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.641168:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.641169:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.641377:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.641383:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641392:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.641395:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.641399:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641408:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641415:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641422:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641444:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136123.641823:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.641829:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641841:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.641844:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.641848:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641874:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641882:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641888:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.641896:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789136123.642298:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.642304:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.642313:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.642316:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.642320:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.642330:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.642349:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.642357:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.642365:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789136123.642700:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136123.642709:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642717:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.642722:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642732:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642749:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642766:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c1dd62/0x559c8745c6de3e91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642782:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136123.642786:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642793:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.642796:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642804:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642815:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642822:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053b979d0/0x559c8745c6de3e98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642833:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136123.642837:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642843:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.642851:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642877:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642888:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642895:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f262408e/0x559c8745c6de3e9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.642908:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.642910:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.642912:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.643011:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.643185:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.643196:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.643199:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.643203:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.643213:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.643222:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.643229:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.643297:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136123.647361:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.647375:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.647393:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.647398:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.647405:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.647420:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.647430:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.647438:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.648910:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136123.648923:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.648936:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.648941:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.648953:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.648973:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.648997:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d01d76/0x559c8745c6de3ea6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.651680:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136123.651696:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.651709:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136123.651714:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.651724:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.651746:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.651758:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.651760:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136123.651763:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.653333:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136123.654358:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789136123.654372:0:19267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de3ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.654956:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.655231:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.655241:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.655278:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.655283:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.655292:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.655309:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.655319:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.655328:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.655358:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136123.655990:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.656000:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656013:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.656018:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.656023:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656046:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656070:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656078:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656101:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136123.656115:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136123.656122:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656130:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136123.656135:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656146:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656165:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656173:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7f4257f/0x559c8745c6de3eb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656192:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136123.656201:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656208:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136123.656212:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656220:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656232:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656239:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1b25201/0x559c8745c6de3ebb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656252:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136123.656265:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136123.656267:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.656314:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.656841:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.656847:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656876:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.656880:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.656885:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656908:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656916:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656923:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.656935:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136123.656947:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136123.656955:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.656966:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136123.656970:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.656980:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.656995:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.657017:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec470a54/0x559c8745c6de3ec2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.657034:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.657036:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.657038:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.657301:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.657307:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657316:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.657319:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.657323:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657332:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657340:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657358:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657368:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136123.657697:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.657704:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657713:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.657717:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.657721:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657731:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657740:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657748:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.657771:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789136123.658120:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.658126:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658140:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.658143:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.658147:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658155:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658163:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658169:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658178:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789136123.658441:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.658447:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658455:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.658458:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.658463:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658471:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658597:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658605:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658615:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789136123.658842:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.658848:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658880:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.658883:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.658888:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658897:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658904:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658911:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.658930:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789136123.659207:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.659213:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659223:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.659226:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.659230:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659241:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659249:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659268:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659278:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1789136123.659446:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789136123.659453:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659461:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802045200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.659466:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659475:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659495:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659502:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0fa6f96/0x559c8745c6de3ec9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659523:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789136123.659526:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659532:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.659535:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659554:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659564:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659572:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007948c3e2/0x559c8745c6de3ed0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659587:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789136123.659590:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659597:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802045400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.659600:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659607:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659616:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659623:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9227097/0x559c8745c6de3ed7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659648:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789136123.659652:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659658:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802044c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.659661:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659668:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659676:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659682:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d35495d7/0x559c8745c6de3ede lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659692:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136123.659695:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659699:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a802045c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.659702:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659720:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659729:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659735:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc3d5b71/0x559c8745c6de3ee5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659745:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136123.659748:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659753:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.659756:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659763:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659772:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659779:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de3eec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.659802:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136123.659804:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136123.659805:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.659830:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.659836:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659846:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.659870:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.659875:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659885:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659893:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659899:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.659915:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136123.660050:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136123.660054:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.660062:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fa00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136123.660065:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.660073:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.660084:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.660091:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a660e1fa/0x559c8745c6de3ef3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136123.660105:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136123.660107:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136123.660108:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.660307:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136123.661786:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136123.661795:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.661810:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=571s v=(0 0) 00010000:00010000:3.0:1789136123.661815:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136123.661821:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.661833:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.661843:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.661881:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136123.661899:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136123.663187:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136123.663198:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.663210:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=571s v=(0 0) 00010000:00010000:2.0:1789136123.663220:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136123.663227:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.663240:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.663249:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.663269:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136123.663295:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789136123.663317:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136123.663326:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663337:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136123.663342:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663352:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789136123.663355:0:19267:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:0.0:1789136123.663375:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663384:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de3efa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663404:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136123.663409:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663424:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136123.663428:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663437:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136123.663450:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136123.663457:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17778:x1876044666853120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74815us (74989us total) trans 0 rc 0/0 00010000:00010000:0.0:1789136123.663463:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000254aa012/0x559c8745c6de3f01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136123.663474:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789136123.663484:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.663487:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136123.663489:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136123.663555:0:17778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17778:1876044666853120:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789136123.663574:0:17778:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789136123.663625:0:17778:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17778:1876044666853248:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136123.663658:0:17778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136123.663690:0:17778:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c86460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136123.663704:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853248 00000100:00100000:2.0:1789136123.663709:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853248 00010000:00010000:1.0:1789136123.663727:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136123.663742:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136123.663750:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17778:x1876044666853248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789136123.663791:0:19267:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1789136123.674981:0:19261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789136123.675037:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789136123.675976:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17778:x1876044666853248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12221us (12312us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789136123.675990:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136123.676021:0:17778:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789136123.676031:0:17778:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17778:1876044666853248:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789136123.676048:0:17778:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1789136124.264748:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136124.777928:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666853376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136124.777997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136124.778061:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853376 00000100:00100000:0.0:1789136124.778077:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853376 00000100:00100000:0.0:1789136124.778120:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136124.778127:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666853376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136124.778160:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136124.778198:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666853376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136124.778205:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136124.778263:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666853376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136124.786892:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136124.786919:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666853504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136124.787004:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136124.787151:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853504 00000100:00100000:1.0:1789136124.787167:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853504 00000100:00100000:1.0:1789136124.787227:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789136124.787249:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666853504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136124.787294:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136124.787365:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666853504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136124.787372:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136124.787452:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666853504:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789136125.288350:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136125.288416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666853632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136125.288492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136125.288596:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853632 00000100:00100000:1.0:1789136125.288604:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853632 00000100:00100000:1.0:1789136125.288652:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789136125.288659:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666853632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136125.288688:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136125.288769:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666853632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136125.288774:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789136125.288915:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666853632:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789136126.058470:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136126.312653:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136127.335992:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136128.361977:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136128.876600:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136128.876623:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666853760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136128.876692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789136128.876918:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136128.876922:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136128.876926:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136128.876931:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 571 00000100:00080000:0.0:1789136128.876935:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789136128.876941:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136128.876960:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7d55afc00 x1876044666854144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136128.877011:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136128.877015:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136128.877017:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136128.877020:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:0.0:1789136128.877023:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789136128.877026:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136128.877035:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3cb40 x1876044666854656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136128.877252:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666854400:0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.877285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136128.877304:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666855040:0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.877338:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136128.877360:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789136128.877365:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.877386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136128.877402:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666854912:0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.877419:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136128.877446:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853760 00000100:00100000:0.0:1789136128.877452:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853760 00000100:00100000:0.0:1789136128.877498:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136128.877506:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666853760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136128.877533:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136128.877569:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666853760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136128.877576:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136128.877656:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666853888:0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.877687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136128.877713:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666854528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.877736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136128.877759:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789136128.877765:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666854016:0@lo:400:kworker.0 00000100:00100000:3.0:1789136128.877773:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854528 00000100:00100000:3.0:1789136128.877777:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854528 00000100:00100000:3.0:1789136128.877807:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136128.877814:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666854528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136128.877889:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666854144:0@lo:8:kworker.0 00000100:00100000:0.0:1789136128.877947:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136128.878190:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666854528:12345-0@lo:400:kworker.0 Request processed in 376us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136128.878197:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136128.878278:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854400 00000100:00100000:1.0:1789136128.878283:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854400 00000100:00100000:1.0:1789136128.878302:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854016 00000100:00100000:1.0:1789136128.878304:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854016 00000100:00100000:1.0:1789136128.878315:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136128.878321:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.878366:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666854400:12345-0@lo:400:kworker.0 Request processed in 45us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136128.878373:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136128.878394:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136128.878400:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666854016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.878425:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666854016:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136128.878430:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789136128.878522:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666854400:0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.881788:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855040 00000100:00100000:1.0:1789136128.881804:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855040 00000100:00100000:1.0:1789136128.882207:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854272 00000100:00100000:1.0:1789136128.882211:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854272 00000100:00100000:1.0:1789136128.882227:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854912 00000100:00100000:1.0:1789136128.882229:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854912 00000100:00100000:1.0:1789136128.882250:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136128.882261:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666855040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.882356:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666855040:12345-0@lo:400:kworker.0 Request processed in 97us (5017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136128.882365:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136128.882384:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136128.882391:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666854272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.882420:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666854272:12345-0@lo:400:kworker.0 Request processed in 30us (5032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136128.882426:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136128.882438:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136128.882445:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666854912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.882472:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666854912:12345-0@lo:400:kworker.0 Request processed in 28us (5051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136128.882478:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136128.882533:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666853760:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789136128.882828:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3cf00 x1876044666854272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136128.882841:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666854272:0@lo:400:kworker.0 00010000:00080000:3.0:1789136128.882894:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69ead00 x1876044666854912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136128.882903:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666854912:0@lo:400:kworker.0 00010000:00080000:3.0:1789136128.882916:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c69e83c0 x1876044666855040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136128.882925:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666855040:0@lo:400:kworker.0 00000100:00100000:2.0:1789136128.884338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136128.884425:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666854656:0@lo:8:kworker.0 00000100:00100000:2.0:1789136128.884458:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789136128.884606:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136128.886724:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666854016:0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.886743:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666854784:0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.886818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136128.886881:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854784 00000100:00100000:1.0:1789136128.886887:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854784 00000100:00100000:1.0:1789136128.886946:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136128.886955:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666854784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.887056:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666854784:12345-0@lo:400:kworker.0 Request processed in 101us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136128.887064:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789136128.887106:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3e3ed00 x1876044666854784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136128.887118:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666854784:0@lo:400:kworker.0 00000100:00100000:1.0:1789136128.887137:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666854528:0@lo:400:kworker.0 00000100:00080000:0.0:1789136128.887468:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136128.887473:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136128.887490:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666853888 00000100:00100000:0.0:1789136128.887494:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666853888 00000100:00100000:0.0:1789136128.887544:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789136128.887561:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:3638:x1876044666853888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136128.887604:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:3638:x1876044666853888:12345-0@lo:400:kworker.0 Request processed in 44us (9916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136128.887624:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789136128.890656:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854144 00000100:00100000:3.0:1789136128.890670:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854144 00000100:00100000:3.0:1789136128.890725:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666854656 00000100:00100000:3.0:1789136128.890729:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666854656 00000100:00100000:3.0:1789136128.890807:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136128.890816:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666854144:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789136128.890842:0:19266:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136128.890953:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666854144:12345-0@lo:8:kworker.0 Request processed in 135us (6620us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136128.890961:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136128.890977:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136128.890981:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666854656:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789136128.891003:0:19266:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136128.891042:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666854656:12345-0@lo:8:kworker.0 Request processed in 59us (6582us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136128.891049:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789136128.892725:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136128.892738:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136128.892744:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666854144:0@lo:8:kworker.0 00000100:00080000:2.0:1789136128.892756:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136128.892760:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136128.892762:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666854656:0@lo:8:kworker.0 00000100:00100000:1.0:1789136128.892934:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666853888:0@lo:400:kworker.0 00010000:00010000:1.0:1789136129.387228:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136129.898053:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666855168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136129.898134:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136129.898212:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855168 00000100:00100000:1.0:1789136129.898219:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855168 00000100:00100000:1.0:1789136129.898269:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136129.898279:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666855168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136129.898322:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136129.898373:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666855168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136129.900692:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136129.900773:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666855168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136129.900796:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136129.900807:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666855296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136129.900889:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136129.901776:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855296 00000100:00100000:2.0:1789136129.901784:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855296 00000100:00100000:2.0:1789136129.901827:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136129.901837:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666855296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136129.901894:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136129.901965:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666855296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136129.901987:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136129.902329:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666855296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136130.410484:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666855424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136130.410572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136130.410637:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855424 00000100:00100000:2.0:1789136130.410644:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855424 00000100:00100000:2.0:1789136130.410698:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789136130.410707:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666855424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136130.410739:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136130.410785:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666855424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136130.410791:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789136130.410839:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666855424:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789136130.413025:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136130.667065:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136131.433320:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789136132.272515:0:20082:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789136132.272520:0:20082:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789136132.272522:0:20082:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789136132.272806:0:20082:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7ff501000 00000020:01000004:1.0:1789136132.272825:0:20082:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789136132.272840:0:20082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789136132.272873:0:20082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a7e6e98000) 00000020:00000080:1.0:1789136132.272891:0:20082:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789136132.383546:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789136132.388656:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789136132.389064:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789136132.389274:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789136132.389520:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789136132.389714:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789136132.400850:0:20082:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789136132.404143:0:20082:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789136132.404432:0:20082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789136132.404447:0:20082:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789136132.404460:0:20082:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x559c8745c6de3f0f 00000020:01000004:0.0:1789136132.404467:0:20082:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789136132.404568:0:20082:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789136132.404572:0:20082:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789136132.404577:0:20082:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789136132.404605:0:20082:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789136132.404609:0:20082:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789136132.442526:0:20082:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789136132.442570:0:20082:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789136132.442575:0:20082:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789136132.442576:0:20082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789136132.442578:0:20082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136132.442579:0:20082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136132.442580:0:20082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136132.442581:0:20082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136132.442582:0:20082:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789136132.442584:0:20082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136132.442585:0:20082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789136132.442589:0:20082:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789136132.442591:0:20082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789136132.442592:0:20082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789136132.442593:0:20082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136132.442595:0:20082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136132.442596:0:20082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136132.442602:0:20082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136132.442603:0:20082:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789136132.442604:0:20082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136132.442604:0:20082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789136132.442633:0:20082:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789136132.442656:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855552:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789136132.442736:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136132.442793:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce847480 going to sleep for 11 seconds 00000100:00100000:0.0:1789136132.442948:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855552 00000100:00100000:0.0:1789136132.442957:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855552 00000100:00100000:0.0:1789136132.443021:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789136132.443031:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:20082:x1876044666855552:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136132.443077:0:17746:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789136132.443081:0:17746:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789136132.443085:0:17746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789136132.443562:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:20082:x1876044666855552:12345-0@lo:253:mount.lustre.0 Request processed in 531us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.443570:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789136132.443746:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789136132.443758:0:20082:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789136132.443760:0:20082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789136132.443761:0:20082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789136132.443763:0:20082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136132.443764:0:20082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136132.443765:0:20082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136132.443766:0:20082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136132.443767:0:20082:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789136132.443768:0:20082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136132.443769:0:20082:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789136132.443791:0:20082:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7ff501000 from lustre-OST0001 10000000:01000000:1.0:1789136132.443818:0:20082:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789136132.443821:0:20082:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789136132.443830:0:20082:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a6c2b94ed8 local copy 00010000:00010000:1.0:1789136132.443840:0:20082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136132.443953:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855680:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136132.443985:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136132.444011:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce847900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136132.444151:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855680 00000100:00100000:0.0:1789136132.444157:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855680 00000100:00100000:0.0:1789136132.444244:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789136132.444260:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:20082:x1876044666855680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136132.444349:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:20082:x1876044666855680:12345-0@lo:501:mount.lustre.0 Request processed in 90us (363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136132.444356:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789136132.444425:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855680:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789136132.444438:0:20082:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789136132.444455:0:20082:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789136132.444466:0:20082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136132.444485:0:20082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136132.444511:0:20082:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7ff501000 10000000:01000000:1.0:1789136132.444516:0:20082:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789136132.444522:0:20082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789136132.444524:0:20082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136132.444528:0:20082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789136132.444531:0:20082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789136132.444552:0:20082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136132.444560:0:20082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136132.444570:0:20082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136132.444583:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136132.444613:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136132.455008:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ce847900 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.456822:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855808 00000100:00100000:2.0:1789136132.456835:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855808 00000100:00100000:2.0:1789136132.456919:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789136132.456930:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:20082:x1876044666855808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136132.456947:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136132.456964:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3f1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3f16 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.456992:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3f16 expref: 22 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.457005:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3f1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3f16 expref: 22 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.457014:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4a00, rc 0) 00000100:00100000:2.0:1789136132.457116:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666855808:12345-0@lo:101:mount.lustre.0 Request processed in 187us (12501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.457124:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789136132.457657:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136132.457679:0:20082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136132.457689:0:20082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136132.462250:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136132.468891:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789136132.469751:0:20082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136132.473147:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789136132.473206:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789136132.473223:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789136132.473239:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789136132.473254:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789136132.473268:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789136132.473296:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789136132.473302:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789136132.473760:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136132.473831:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.473990:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136132.474062:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666855936 00000100:00100000:3.0:1789136132.474071:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666855936 00000100:00100000:2.0:1789136132.474781:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789136132.474796:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666855936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136132.475140:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666855936:12345-0@lo:501:mount.lustre.0 Request processed in 347us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.475148:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789136132.475763:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666855936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136132.475813:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136132.476129:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.476208:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.476245:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856064 00000100:00100000:2.0:1789136132.476253:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856064 00000100:00100000:2.0:1789136132.476348:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789136132.476358:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136132.477288:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856064:12345-0@lo:503:mount.lustre.0 Request processed in 926us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.477300:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789136132.477486:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856064:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789136132.477933:0:20082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789136132.478010:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136132.478058:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.478787:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.478990:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856192 00000100:00100000:2.0:1789136132.478996:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856192 00000100:00100000:2.0:1789136132.479031:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789136132.479040:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.479805:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856192:12345-0@lo:502:mount.lustre.0 Request processed in 762us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.479816:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789136132.479967:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136132.480188:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789136132.480219:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789136132.480234:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789136132.480247:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789136132.480258:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789136132.480271:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789136132.480286:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789136132.480299:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789136132.480325:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1789136132.480381:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136132.480430:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.480460:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.480724:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856320 00000100:00100000:2.0:1789136132.480730:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856320 00000100:00100000:2.0:1789136132.480759:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789136132.480768:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.480896:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856320:12345-0@lo:502:mount.lustre.0 Request processed in 128us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.480902:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789136132.481117:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136132.481165:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1789136132.481174:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789136132.486425:0:20086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789136132.486437:0:20086:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789136132.486445:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136132.486448:0:20086:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789136132.486456:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136132.486502:0:20086:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a6c470ced8) 00000020:00000080:2.0:1789136132.486531:0:20086:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789136132.486539:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136132.486610:0:20086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7ff501000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789136132.486620:0:20086:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136132.486627:0:20086:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x559c8745c6de3f2b 00010000:00010000:2.0:1789136132.489693:0:20086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789136132.493841:0:20086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1789136132.495716:0:20086:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1789136132.499299:0:20086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789136132.499312:0:20086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.499320:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.499322:0:20086:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789136132.499326:0:20086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.499341:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.499343:0:20086:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789136132.499346:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789136132.499348:0:20086:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789136132.499351:0:20086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.499353:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.499355:0:20086:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789136132.499357:0:20086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.499360:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.499361:0:20086:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789136132.499364:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789136132.499393:0:20086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.499396:0:20086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.499398:0:20086:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789136132.499401:0:20086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789136132.503883:0:20082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789136132.503938:0:20082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789136132.503970:0:20082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.503985:0:20082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136132.503995:0:20082:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7ff501000 from 1 10000000:01000000:0.0:1789136132.503999:0:20082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789136132.504045:0:20082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.504065:0:20082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.504079:0:20082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136132.504138:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136132.504212:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.504257:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.507136:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856448 00000100:00100000:2.0:1789136132.507155:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856448 00000100:00100000:2.0:1789136132.507234:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789136132.507245:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:20082:x1876044666856448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136132.507263:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136132.507280:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3f32 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.507310:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.507322:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.507341:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5800, rc 0) 00000100:00100000:2.0:1789136132.507642:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856448:12345-0@lo:101:mount.lustre.0 Request processed in 398us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.507649:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789136132.507756:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136132.507775:0:20082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.507786:0:20082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136132.509076:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789136132.509669:0:20082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136132.514079:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789136132.514163:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789136132.514192:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789136132.514198:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789136132.514312:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136132.514709:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.514819:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.515822:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856576 00000100:00100000:2.0:1789136132.515835:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856576 00000100:00100000:2.0:1789136132.515933:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789136132.515943:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136132.516117:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856576:12345-0@lo:501:mount.lustre.0 Request processed in 175us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.516126:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789136132.516254:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136132.516304:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136132.516393:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.516433:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.516665:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856704 00000100:00100000:2.0:1789136132.516670:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856704 00000100:00100000:2.0:1789136132.516705:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789136132.516712:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136132.516798:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856704:12345-0@lo:503:mount.lustre.0 Request processed in 86us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.516804:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789136132.519612:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789136132.520076:0:20082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789136132.520175:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136132.520253:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.520309:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.523753:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856832 00000100:00100000:2.0:1789136132.523767:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856832 00000100:00100000:2.0:1789136132.523831:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789136132.523841:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.524029:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856832:12345-0@lo:502:mount.lustre.0 Request processed in 189us (3776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.524037:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789136132.524188:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136132.524451:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789136132.524786:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789136132.524805:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789136132.524820:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789136132.524850:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789136132.524901:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789136132.524915:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789136132.524928:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:0.0:1789136132.524942:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:0.0:1789136132.524955:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:0.0:1789136132.524970:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:0.0:1789136132.524982:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:0.0:1789136132.524994:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:0.0:1789136132.525006:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:0.0:1789136132.525019:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:0.0:1789136132.525033:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:0.0:1789136132.525045:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:0.0:1789136132.525083:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136132.525154:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.525199:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.525290:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666856960 00000100:00100000:2.0:1789136132.525295:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666856960 00000100:00100000:2.0:1789136132.525351:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789136132.525376:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.525465:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666856960:12345-0@lo:502:mount.lustre.0 Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.525472:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789136132.528808:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666856960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136132.528932:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:0.0:1789136132.528950:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789136132.531243:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.531256:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.531259:0:20090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789136132.531265:0:20090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7ff501000 00000020:00000080:1.0:1789136132.531269:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136132.531278:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.531281:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.531282:0:20090:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789136132.531291:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.531294:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.531296:0:20090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789136132.531299:0:20090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7ff501000 00000020:00000080:1.0:1789136132.531302:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136132.533378:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.533391:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.533393:0:20090:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789136132.533397:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.533400:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.533402:0:20090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136132.533407:0:20090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff501000 00000020:00000080:1.0:1789136132.533409:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136132.536617:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.536634:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.536636:0:20090:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136132.536640:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.536644:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.536646:0:20090:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136132.536651:0:20090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff501000 00000020:00000080:1.0:1789136132.536653:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136132.537245:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.537250:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.537252:0:20090:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136132.537256:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.537258:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.537260:0:20090:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136132.537264:0:20090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff501000 00000020:00000080:1.0:1789136132.537266:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136132.537287:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.537290:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.537292:0:20090:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136132.537294:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136132.537311:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.537312:0:20090:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789136132.537317:0:20090:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff501000 00000020:00000080:1.0:1789136132.537319:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136132.538008:0:20090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136132.538013:0:20090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136132.538015:0:20090:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789136132.538019:0:20090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789136132.558769:0:20082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789136132.558819:0:20082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136132.558850:0:20082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.558878:0:20082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136132.558988:0:20082:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789136132.558991:0:20082:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7ff501000 10000000:01000000:0.0:1789136132.558994:0:20082:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7ff501000 10000000:01000000:0.0:1789136132.558998:0:20082:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136132.559004:0:20082:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7ff501000 from 1 10000000:01000000:0.0:1789136132.559007:0:20082:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789136132.559042:0:20082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.559051:0:20082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.559062:0:20082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136132.559087:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136132.559172:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.559216:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.560703:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857088 00000100:00100000:2.0:1789136132.560715:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857088 00000100:00100000:2.0:1789136132.560774:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789136132.560784:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+23:20082:x1876044666857088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136132.560799:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136132.560815:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5e00/0x559c8745c6de3f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3f40 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.560842:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5e00/0x559c8745c6de3f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3f40 expref: 24 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.560868:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5e00/0x559c8745c6de3f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3f40 expref: 24 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136132.560878:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5e00, rc 0) 00000100:00100000:2.0:1789136132.560943:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857088:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.560950:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789136132.564508:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136132.564553:0:20082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136132.564565:0:20082:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136132.579635:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1789136132.579991:0:20082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136132.580223:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789136132.580247:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789136132.580260:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789136132.580273:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789136132.580286:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789136132.580313:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789136132.580326:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789136132.580358:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789136132.580378:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789136132.580392:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789136132.580404:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789136132.580416:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789136132.580427:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789136132.580439:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789136132.580451:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789136132.580464:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789136132.580477:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789136132.580491:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789136132.580502:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789136132.580514:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789136132.580526:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789136132.580554:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789136132.580570:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789136132.580595:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789136132.580611:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789136132.580623:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789136132.580635:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789136132.580646:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789136132.580658:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789136132.580671:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789136132.580684:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789136132.580696:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789136132.580708:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789136132.580721:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789136132.580733:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789136132.580744:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789136132.580755:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789136132.580784:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789136132.580799:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1789136132.580811:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1789136132.580823:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1789136132.580834:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1789136132.580847:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1789136132.580886:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1789136132.580900:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1789136132.580912:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1789136132.580931:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1789136132.580936:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1789136132.581034:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136132.581116:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136132.581174:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136132.583949:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857216 00000100:00100000:0.0:1789136132.583962:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857216 00000100:00100000:0.0:1789136132.584009:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789136132.584018:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136132.584205:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857216:12345-0@lo:501:mount.lustre.0 Request processed in 187us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.584213:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789136132.586809:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136132.586906:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136132.586979:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136132.587026:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e01d6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.587124:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857344 00000100:00100000:2.0:1789136132.587131:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857344 00000100:00100000:2.0:1789136132.587204:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789136132.587214:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857344:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136132.587322:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857344:12345-0@lo:503:mount.lustre.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.587335:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789136132.587464:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136132.587909:0:20082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136132.587981:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.588022:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136132.588050:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857472 00000100:00100000:2.0:1789136132.588054:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857472 00000100:00100000:2.0:1789136132.588079:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789136132.588085:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.588185:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857472:12345-0@lo:502:mount.lustre.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.588193:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789136132.588226:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.588239:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136132.591108:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789136132.591180:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789136132.591195:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789136132.591208:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789136132.591220:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789136132.591232:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789136132.591246:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789136132.591259:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789136132.591271:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789136132.591283:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789136132.591295:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789136132.591308:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789136132.591320:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789136132.591576:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789136132.591590:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789136132.591603:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789136132.591618:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789136132.591632:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789136132.591644:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789136132.591656:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789136132.591669:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789136132.591683:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789136132.591698:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789136132.591713:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789136132.591726:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789136132.591739:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789136132.591750:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789136132.591762:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789136132.591774:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789136132.591787:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789136132.591798:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789136132.591812:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789136132.591824:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789136132.591836:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789136132.591850:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789136132.591885:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789136132.591921:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789136132.591936:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789136132.591948:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789136132.591960:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789136132.591971:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789136132.591983:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789136132.591995:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789136132.592008:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789136132.592020:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789136132.592032:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789136132.592056:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789136132.592068:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789136132.592142:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.592229:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136132.592277:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857600 00000100:00100000:2.0:1789136132.592283:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857600 00000100:00100000:2.0:1789136132.592342:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789136132.592352:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.592468:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857600:12345-0@lo:502:mount.lustre.0 Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.592476:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789136132.592542:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.592564:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136132.592738:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789136132.592760:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789136132.592780:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.592812:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136132.592838:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857728 00000100:00100000:2.0:1789136132.592842:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857728 00000100:00100000:2.0:1789136132.592899:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789136132.592907:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136132.592965:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666857728:12345-0@lo:502:mount.lustre.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136132.592972:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789136132.593001:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.593013:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666857728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136132.593053:0:20082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789136132.593060:0:20082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789136132.600691:0:20095:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789136132.600710:0:20095:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a7efa1b490) 00000020:00000080:0.0:1789136132.600736:0:20095:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1789136132.600828:0:20095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7ff501000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789136132.600833:0:20095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7ff501000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789136132.600836:0:20095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7ff501000 3 00010000:00080000:0.0:1789136132.600900:0:20095:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c47ca800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789136132.609578:0:20095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1789136132.609848:0:20095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789136132.609920:0:20095:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789136132.609935:0:20095:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x559c8745c6de3f55 00000100:00080000:0.0:1789136132.609946:0:20095:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136132.609952:0:20095:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a6c47ca800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136132.609988:0:20095:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ff6940 x1876044666857856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136132.610046:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666857856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136132.610131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.610204:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857856 00000100:00100000:0.0:1789136132.610212:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857856 00000100:00100000:0.0:1789136132.610246:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136132.610253:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666857856:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789136132.610301:0:17753:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1789136132.615182:0:17753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x559c8745c6de3f5c 00000004:00100000:0.0:1789136132.615204:0:17753:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789136132.615252:0:17753:0:(import.c:65:import_set_state_nolock()) ffff90a7d28fa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136132.615350:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876044666857856:12345-0@lo:38:llog_process_th.0 Request processed in 5094us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.615361:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789136132.615402:0:20095:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136132.615475:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136132.615480:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136132.615483:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136132.615488:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1789136132.615491:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789136132.615496:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136132.615532:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c47e7c00 x1876044666858240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136132.615563:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136132.615567:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136132.615575:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136132.615579:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1789136132.615582:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789136132.615586:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136132.615598:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c47e52c0 x1876044666858752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136132.615647:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666857984:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.615715:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666858624:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.615761:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789136132.615767:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666858496:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.615807:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666859136:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.615878:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666858112:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.615920:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666858880:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615939:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.615955:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789136132.615960:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666858368:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.615990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.616005:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666859008:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616024:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.616051:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666857984 00000100:00100000:0.0:1789136132.616062:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666857984 00000100:00100000:0.0:1789136132.616090:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858496 00000100:00100000:0.0:1789136132.616105:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858496 00000100:00100000:0.0:1789136132.616122:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136132.616130:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616174:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666857984:12345-0@lo:400:kworker.0 Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616181:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136132.616194:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136132.616200:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666858496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616224:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666858496:12345-0@lo:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616231:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136132.616247:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858624 00000100:00100000:0.0:1789136132.616250:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858624 00000100:00100000:0.0:1789136132.616279:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858112 00000100:00100000:0.0:1789136132.616281:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858112 00000100:00100000:0.0:1789136132.616298:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136132.616304:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666858624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616332:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666858624:12345-0@lo:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616339:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136132.616349:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136132.616354:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666858112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616381:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666858112:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616387:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136132.616415:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859136 00000100:00100000:0.0:1789136132.616419:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859136 00000100:00100000:0.0:1789136132.616438:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858880 00000100:00100000:0.0:1789136132.616441:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858880 00000100:00100000:0.0:1789136132.616450:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858368 00000100:00100000:0.0:1789136132.616452:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858368 00000100:00100000:0.0:1789136132.616461:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859008 00000100:00100000:0.0:1789136132.616463:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859008 00000100:00100000:0.0:1789136132.616475:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789136132.616482:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666859136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616514:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666859136:12345-0@lo:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616520:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789136132.616531:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789136132.616536:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666858880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616562:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666858880:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616568:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789136132.616579:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136132.616585:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666858368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616609:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666858368:12345-0@lo:400:kworker.0 Request processed in 24us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616614:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136132.616625:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789136132.616631:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666859008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616656:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666859008:12345-0@lo:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.616670:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789136132.616700:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136132.616704:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136132.616706:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789136132.616737:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c47e4b40 x1876044666858368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136132.616749:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666858368:0@lo:400:kworker.0 00010000:00080000:0.0:1789136132.616759:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c47e5680 x1876044666859008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136132.616767:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666859008:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616776:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666858112:0@lo:400:kworker.0 00010000:00080000:0.0:1789136132.616784:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c47e43c0 x1876044666858880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136132.616792:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666858880:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616833:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666858496:0@lo:400:kworker.0 00010000:00080000:0.0:1789136132.616843:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c47e4f00 x1876044666859136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136132.616851:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666859136:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616891:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666857984:0@lo:400:kworker.0 00000100:00100000:0.0:1789136132.616902:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666858624:0@lo:400:kworker.0 00000100:00100000:1.0:1789136132.617191:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666858240:0@lo:8:kworker.0 00000100:00100000:1.0:1789136132.617232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136132.617261:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666858752:0@lo:8:kworker.0 00000100:00100000:1.0:1789136132.617280:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789136132.617304:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ff6940 x1876044666857856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136132.617313:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136132.617321:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789136132.617340:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789136132.617344:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789136132.617347:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136132.617354:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666857856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136132.623475:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858240 00000100:00100000:0.0:1789136132.623498:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858240 00000100:00100000:0.0:1789136132.623536:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666858752 00000100:00100000:0.0:1789136132.623540:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666858752 00000100:00100000:0.0:1789136132.623561:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136132.623569:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666858240:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789136132.623678:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666858240:12345-0@lo:8:kworker.0 Request processed in 108us (6444us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789136132.623685:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136132.623702:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136132.623707:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666858752:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789136132.623740:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1876044666858752:12345-0@lo:8:kworker.0 Request processed in 32us (6458us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789136132.623746:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136132.623793:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136132.623801:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136132.623806:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789136132.623810:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666858240:0@lo:8:kworker.0 00000100:00100000:0.0:1789136132.623819:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136132.623822:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136132.623824:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789136132.623827:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666858752:0@lo:8:kworker.0 00000020:01000004:0.0:1789136132.623954:0:20095:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789136132.623969:0:20095:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90a8018d4ed8) 00000020:00000080:0.0:1789136132.623989:0:20095:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789136132.624075:0:20095:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7ff501000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789136132.624079:0:20095:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7ff501000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789136132.624081:0:20095:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7ff501000 3 00010000:00080000:0.0:1789136132.624125:0:20095:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c47cd800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789136132.635339:0:20095:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789136132.635573:0:20095:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789136132.635624:0:20095:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789136132.635637:0:20095:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x559c8745c6de3f6a 00000100:00080000:0.0:1789136132.635647:0:20095:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136132.635653:0:20095:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a6c47cd800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136132.635691:0:20095:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c96d12c0 x1876044666859264/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136132.635739:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666859264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136132.635841:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.635953:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859264 00000100:00100000:0.0:1789136132.635960:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859264 00000100:00100000:0.0:1789136132.635989:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136132.635996:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666859264:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789136132.636020:0:17755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:0.0:1789136132.636052:0:17755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x559c8745c6de3f71 00000004:00100000:0.0:1789136132.636066:0:17755:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136132.637926:0:20095:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789136132.644600:0:17755:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136132.644723:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876044666859264:12345-0@lo:38:llog_process_th.0 Request processed in 8721us (8878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.644735:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789136132.644927:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7c96d12c0 x1876044666859264/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136132.644939:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136132.644948:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789136132.644964:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789136132.644969:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789136132.644971:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c47cd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789136132.644978:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666859264:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789136132.650049:0:20095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789136132.652086:0:20082:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789136132.652148:0:20082:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789136132.652168:0:20082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.652190:0:20082:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789136132.652245:0:20082:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789136132.652247:0:20082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136132.652249:0:20082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136132.652250:0:20082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136132.652251:0:20082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136132.652253:0:20082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136132.652254:0:20082:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136132.652256:0:20082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136132.652257:0:20082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136132.652261:0:20082:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789136132.652264:0:20082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789136132.652265:0:20082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136132.652266:0:20082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136132.652267:0:20082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136132.652269:0:20082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136132.652270:0:20082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136132.652271:0:20082:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136132.652272:0:20082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136132.652273:0:20082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136132.652300:0:20082:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789136132.652320:0:20082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666859392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789136132.652501:0:20082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136132.652545:0:20082:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2810780 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.653640:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859392 00000100:00100000:2.0:1789136132.653652:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859392 00000100:00100000:2.0:1789136132.653707:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789136132.653717:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666859392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789136132.653750:0:17746:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789136132.653913:0:17746:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789136132.678798:0:17746:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789136132.678821:0:17746:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789136132.679342:0:17769:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789136132.679348:0:17769:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789136132.679517:0:17769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.679538:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 24 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.679568:0:17769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 24 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.679575:0:17769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.679615:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 24 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.679673:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 24 pid: 17745 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136132.679689:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666859520:0@lo:104: 00000100:00100000:3.0:1789136132.679814:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136132.679933:0:17769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 24 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.679942:0:17769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 24 pid: 17746 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136132.679951:0:17769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666859648:0@lo:104: 00000100:00100000:3.0:1789136132.679974:0:17769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136132.680140:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:20082:x1876044666859392:12345-0@lo:253:mount.lustre.0 Request processed in 26423us (27638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136132.680152:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789136132.680909:0:17769:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2810180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136132.682819:0:20082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:511c13c6-847f-45db-8965-d0deb75673dc:20082:1876044666859392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136132.682838:0:20082:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789136132.682841:0:20082:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136132.682843:0:20082:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136132.682844:0:20082:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136132.682845:0:20082:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136132.682846:0:20082:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136132.682847:0:20082:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136132.682848:0:20082:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136132.682850:0:20082:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136132.682851:0:20082:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136132.682943:0:20082:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789136132.685924:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859520 00000100:00100000:0.0:1789136132.685940:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859520 00000100:00100000:3.0:1789136132.686117:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859648 00000100:00100000:3.0:1789136132.686125:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859648 00000100:00100000:3.0:1789136132.686145:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136132.686154:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:17769:x1876044666859520:12345-0@lo:104: 00010000:00010000:3.0:1789136132.686173:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686288:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136132.686295:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:17769:x1876044666859520:12345-0@lo:104: Request processed in 142us (6539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136132.686304:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136132.686324:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136132.686347:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666859648:12345-0@lo:104: 00010000:00010000:3.0:1789136132.686356:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686398:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789136132.686403:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+3:17769:x1876044666859648:12345-0@lo:104: Request processed in 58us (6429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136132.686409:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136132.686449:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666859520:0@lo:104: 00000100:00100000:3.0:1789136132.686459:0:17769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17769:1876044666859648:0@lo:104: 00010000:00010000:3.0:1789136132.686481:0:17769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686498:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136132.686504:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686512:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136132.686516:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686525:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136132.686538:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136132.686544:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789136132.686576:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686582:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136132.686601:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686608:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c3caf600/0x559c8745c6de3e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3e2f expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686620:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136132.686623:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686629:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136132.686631:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686637:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136132.686643:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136132.686648:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789136132.686667:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686673:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136132.686688:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686693:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878600/0x559c8745c6de3e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3e21 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.686705:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136132.686707:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136132.686709:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136132.686716:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136132.686736:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666859776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136132.686774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136132.686827:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666859904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136132.686849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136132.686906:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859776 00000100:00100000:3.0:1789136132.686911:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859776 00010000:00010000:3.0:1789136132.686927:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 24 pid: 17745 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136132.686946:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666859904 00000100:00100000:3.0:1789136132.686949:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666859904 00010000:00010000:3.0:1789136132.686958:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 25 pid: 17746 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136132.686970:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136132.686976:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+25:3641:x1876044666859776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136132.686993:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136132.686999:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 25 pid: 17745 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687009:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 25 pid: 17745 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687023:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878400/0x559c8745c6de3e2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3e28 expref: 25 pid: 17745 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687034:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136132.687061:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+24:3641:x1876044666859776:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136132.687068:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136132.687081:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136132.687087:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+23:3638:x1876044666859904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136132.687107:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136132.687112:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 23 pid: 17746 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687121:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 23 pid: 17746 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687130:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f4e00/0x559c8745c6de3e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3e1a expref: 23 pid: 17746 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687142:0:17738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687150:0:17738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789136132.687170:0:17738:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007822875s 00010000:00010000:3.0:1789136132.687174:0:17738:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687181:0:17738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687187:0:17738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687192:0:17738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687197:0:17738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136132.687200:0:17738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687206:0:17738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687218:0:17738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687226:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136132.687254:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+22:3638:x1876044666859904:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136132.687259:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789136132.687282:0:17769:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687299:0:17769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136132.687306:0:17769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136132.687337:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666859904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136132.687357:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666859776:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789136132.696339:0:20082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789136132.701502:0:20082:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789136132.701513:0:20082:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789136132.701552:0:20082:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789136132.701598:0:20082:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789136132.701621:0:20082:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789136132.701642:0:20082:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789136132.702521:0:20082:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136132.702755:0:20082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136133.483154:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789136133.820338:0:20151:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136133.820640:0:20151:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789136133.994031:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666860032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136133.994125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136133.994206:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860032 00000100:00100000:2.0:1789136133.994214:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860032 00000100:00100000:2.0:1789136133.994266:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136133.994275:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666860032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136133.994313:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136133.994359:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666860032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136133.994366:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136133.994409:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666860032:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789136134.186098:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136134.186108:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3dd6000 from 10 10000000:01000000:2.0:1789136134.186115:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136134.186167:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.186179:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.186192:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136134.186218:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136134.186289:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136134.186355:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e018ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136134.186408:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860160 00000100:00100000:3.0:1789136134.186415:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860160 00000100:00100000:3.0:1789136134.186471:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789136134.186480:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666860160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136134.186493:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136134.186506:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3f7f expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.186530:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3f7f expref: 23 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.186552:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3f7f expref: 23 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.186561:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f000, rc 0) 00000100:00100000:3.0:1789136134.186607:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666860160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136134.186615:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789136134.186636:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66083c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136134.186651:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136134.186660:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136134.186711:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789136134.186744:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136134.186768:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789136134.186798:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860288 00000100:00100000:3.0:1789136134.186802:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860288 00000100:00100000:3.0:1789136134.186833:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789136134.186839:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666860288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789136134.186874:0:17746:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789136134.186892:0:17746:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789136134.186895:0:17746:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789136134.186972:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666860288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136134.186979:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789136134.187011:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136134.187089:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136134.187096:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.187105:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136134.187113:0:17750:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136134.187118:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7d8b2f000 from 10 10000000:01000000:3.0:1789136134.187120:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136134.187135:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.187142:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.187150:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136134.187161:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136134.187183:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136134.187211:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2810a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136134.187277:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860416 00000100:00100000:2.0:1789136134.187281:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860416 00000100:00100000:2.0:1789136134.187323:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789136134.187347:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666860416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136134.187356:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136134.187366:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f4600/0x559c8745c6de3f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de3f8d expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.187380:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f4600/0x559c8745c6de3f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de3f8d expref: 24 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.187389:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f4600/0x559c8745c6de3f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3f8d expref: 24 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.187395:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4600, rc 0) 00000100:00100000:2.0:1789136134.187429:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666860416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136134.187474:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136134.187484:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136134.187491:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136134.187526:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136134.187554:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136134.187568:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2810a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789136134.187579:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860544 00000100:00100000:3.0:1789136134.187582:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860544 00000100:00100000:2.0:1789136134.190365:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789136134.192477:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789136134.192501:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666860544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789136134.192529:0:17745:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789136134.192560:0:17745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789136134.192565:0:17745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789136134.194128:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666860544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1631us (6565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136134.194142:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789136134.194243:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666860544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789136134.194329:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136134.194341:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.194353:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136134.504101:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136135.016131:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666860672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136135.016211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136135.016316:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860672 00000100:00100000:1.0:1789136135.016324:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860672 00000100:00100000:1.0:1789136135.016378:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136135.016389:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666860672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136135.016427:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136135.016479:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666860672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136135.016486:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789136135.016581:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666860672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136135.020820:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666860800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136135.020924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136135.021024:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860800 00000100:00100000:2.0:1789136135.021033:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860800 00000100:00100000:2.0:1789136135.021106:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136135.021118:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666860800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136135.021143:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136135.021198:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666860800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136135.021205:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789136135.021228:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136135.021274:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666860800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136135.529051:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136135.529076:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666860928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136135.529146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136135.529367:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666860928 00000100:00100000:3.0:1789136135.529375:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666860928 00000100:00100000:3.0:1789136135.529430:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136135.529440:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666860928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136135.529475:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136135.529536:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666860928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136135.529553:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789136135.529613:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666860928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789136135.530096:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136136.297565:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136136.552170:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136137.580389:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136138.093580:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136138.093586:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136138.093590:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136138.093604:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a7f6293800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136138.093629:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c69e83c0 x1876044666861440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136138.093664:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136138.093668:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136138.093670:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136138.093674:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a6c2a09000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136138.093685:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3e3ed00 x1876044666861952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136138.093762:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666861184:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.093844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.093919:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666861824:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.093944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.093964:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666862464:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.093991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.094029:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789136138.094035:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666861312:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.094058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.094076:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666862080:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.094096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.094113:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666862592:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.094136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.094164:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666861440:0@lo:8:kworker.0 00000100:00100000:3.0:1789136138.094187:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136138.094205:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666861952:0@lo:8:kworker.0 00000100:00100000:3.0:1789136138.094226:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.094346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666861568:0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.094401:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666862208:0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094421:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.094435:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789136138.094441:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666861056:0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094468:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.094494:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666861696:0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094516:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.094533:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666862336:0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.094578:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862464 00000100:00100000:1.0:1789136138.094585:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862464 00000100:00100000:1.0:1789136138.094636:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862080 00000100:00100000:1.0:1789136138.094639:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862080 00000100:00100000:1.0:1789136138.094651:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862592 00000100:00100000:1.0:1789136138.094654:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862592 00000100:00100000:1.0:1789136138.094667:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861568 00000100:00100000:1.0:1789136138.094679:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861568 00000100:00100000:1.0:1789136138.094694:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862208 00000100:00100000:1.0:1789136138.094696:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862208 00000100:00100000:1.0:1789136138.094709:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862336 00000100:00100000:1.0:1789136138.094712:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862336 00000100:00100000:1.0:1789136138.094727:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136138.094736:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666862464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094791:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666862464:12345-0@lo:400:kworker.0 Request processed in 55us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.094798:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136138.094817:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136138.094824:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666862080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094870:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666862080:12345-0@lo:400:kworker.0 Request processed in 29us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.094877:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136138.094892:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789136138.094898:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666862592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094928:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666862592:12345-0@lo:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.094934:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789136138.094945:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789136138.094950:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666861568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.094982:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666861568:12345-0@lo:400:kworker.0 Request processed in 32us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.094988:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789136138.095016:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136138.095023:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666862208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.095060:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666862208:12345-0@lo:400:kworker.0 Request processed in 38us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.095066:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136138.095079:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136138.095086:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666862336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.095112:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666862336:12345-0@lo:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.095118:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136138.095140:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861056 00000100:00100000:1.0:1789136138.095143:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861056 00000100:00100000:1.0:1789136138.095173:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789136138.095178:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666861056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136138.095207:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666861056:12345-0@lo:400:kworker.0 Request processed in 29us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.095214:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789136138.095255:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136138.095259:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136138.095287:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666861056:0@lo:400:kworker.0 00010000:00080000:1.0:1789136138.095300:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c47612c0 x1876044666862336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136138.095312:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666862336:0@lo:400:kworker.0 00010000:00080000:1.0:1789136138.095323:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69ead00 x1876044666861568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136138.095332:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666861568:0@lo:400:kworker.0 00010000:00080000:1.0:1789136138.095354:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3fc00 x1876044666862208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136138.095363:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666862208:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.097127:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861184 00000100:00100000:3.0:1789136138.097141:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861184 00000100:00100000:3.0:1789136138.097179:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861696 00000100:00100000:3.0:1789136138.097183:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861696 00000100:00100000:3.0:1789136138.097204:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136138.097213:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666861184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136138.098026:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861824 00000100:00100000:2.0:1789136138.098035:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861824 00000100:00100000:2.0:1789136138.098080:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861312 00000100:00100000:2.0:1789136138.098084:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861312 00000100:00100000:2.0:1789136138.098098:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861440 00000100:00100000:2.0:1789136138.098101:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861440 00000100:00100000:2.0:1789136138.098110:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666861952 00000100:00100000:2.0:1789136138.098112:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666861952 00000100:00100000:2.0:1789136138.098123:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136138.098131:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666861824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136138.098208:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666861824:12345-0@lo:400:kworker.0 Request processed in 78us (4262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136138.098215:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136138.098243:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136138.098250:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666861312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136138.098277:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666861312:12345-0@lo:400:kworker.0 Request processed in 29us (4219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136138.098284:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136138.098294:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136138.098298:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666861440:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136138.098322:0:19266:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:2.0:1789136138.098349:0:19266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de3f9b 00002000:00100000:2.0:1789136138.098375:0:19266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a7f6b2f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789136138.098381:0:19266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789136138.098384:0:19266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136138.098574:0:19266:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789136138.098599:0:19266:0:(import.c:65:import_set_state_nolock()) ffff90a7f6b2f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136138.098645:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666861440:12345-0@lo:8:kworker.0 Request processed in 345us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136138.098652:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136138.098667:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789136138.098671:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666861952:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136138.098699:0:19266:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:2.0:1789136138.098715:0:19266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de3fa2 00002000:00100000:2.0:1789136138.098723:0:19266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90a7f6b2a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789136138.098726:0:19266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789136138.098728:0:19266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136138.098749:0:19266:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789136138.098761:0:19266:0:(import.c:65:import_set_state_nolock()) ffff90a7f6b2b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136138.098788:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666861952:12345-0@lo:8:kworker.0 Request processed in 115us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136138.098794:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789136138.100472:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666861184:12345-0@lo:400:kworker.0 Request processed in 3253us (6621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136138.100492:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136138.100529:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789136138.100540:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666861696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.100592:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666861696:12345-0@lo:400:kworker.0 Request processed in 56us (6075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136138.100598:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789136138.100666:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666861312:0@lo:400:kworker.0 00010000:00080000:3.0:1789136138.100683:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3cf00 x1876044666862080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136138.100694:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666862080:0@lo:400:kworker.0 00010000:00080000:3.0:1789136138.100707:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4762580 x1876044666862592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136138.100715:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666862592:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.100724:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666861184:0@lo:400:kworker.0 00000100:00100000:3.0:1789136138.100734:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666861824:0@lo:400:kworker.0 00010000:00080000:3.0:1789136138.100745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4760b40 x1876044666862464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136138.100753:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666862464:0@lo:400:kworker.0 00010000:00080000:3.0:1789136138.100800:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c69e83c0 x1876044666861440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136138.101024:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136138.101051:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666861696:0@lo:400:kworker.0 00000100:00080000:3.0:1789136138.106335:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789136138.106357:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789136138.106364:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789136138.106368:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789136138.106395:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789136138.106405:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666861440:0@lo:8:kworker.0 00010000:00080000:3.0:1789136138.106446:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3ed00 x1876044666861952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136138.106456:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789136138.106461:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789136138.106464:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789136138.106466:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789136138.106480:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789136138.106484:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666861952:0@lo:8:kworker.0 00000004:00080000:2.0:1789136138.106624:0:18499:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789136138.106723:0:18499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 586225868115ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789136138.106730:0:18499:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789136138.110342:0:17780:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789136138.110379:0:17780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17780:1876044666862848:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789136138.110455:0:17780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.110491:0:17780:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e01d6cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1789136138.110523:0:18500:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789136138.110537:0:18500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18500:1876044666863104:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789136138.110561:0:18500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.110578:0:18500:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e01d6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136138.110592:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666862976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136138.110620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.110644:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136138.110650:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666862720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136138.110669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.110696:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862848 00000100:00100000:1.0:1789136138.110702:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862848 00000100:00100000:1.0:1789136138.110757:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863104 00000100:00100000:1.0:1789136138.110760:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863104 00000100:00100000:1.0:1789136138.110782:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136138.110791:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17780:x1876044666862848:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789136138.111120:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136138.111135:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18500:x1876044666863104:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789136138.111171:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862976 00000100:00100000:1.0:1789136138.111175:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862976 00000100:00100000:1.0:1789136138.111192:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666862720 00000100:00100000:1.0:1789136138.111194:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666862720 00000100:00100000:1.0:1789136138.111205:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136138.111211:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9679a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1876044666862976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136138.111230:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136138.111283:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9679a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1876044666862976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.111291:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136138.111311:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136138.111317:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666862720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136138.111327:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136138.111353:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666862720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.111359:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789136138.111381:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789136138.111410:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c86df480 x1876044666862720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136138.111431:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666862720:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789136138.111443:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3e940 x1876044666862976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136138.111454:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666862976:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1789136138.113933:0:19266:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789136138.113958:0:19266:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789136138.113965:0:19266:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:0.0:1789136138.114344:0:17779:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789136138.114458:0:17779:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 586233602991ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789136138.114466:0:17779:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789136138.116983:0:18489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789136138.124270:0:19572:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789136138.124284:0:19572:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789136138.124439:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18500:x1876044666863104:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13299us (13870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136138.124452:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789136138.124533:0:18500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3cf00 x1876044666863104/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789136154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136138.124549:0:18500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18500:1876044666863104:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789136138.124562:0:18500:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789136138.124603:0:18500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18500:1876044666863232:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789136138.124638:0:18500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136138.124660:0:18500:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136138.124683:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863232 00000100:00100000:0.0:1789136138.124689:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863232 00000100:00100000:0.0:1789136138.124725:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136138.124735:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18500:x1876044666863232:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789136138.124759:0:19265:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789136138.124790:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18500:x1876044666863232:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136138.124797:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789136138.124838:0:18500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c96d21c0 x1876044666863232/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136154 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136138.124893:0:18500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18500:1876044666863232:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789136138.124902:0:18500:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789136138.124940:0:18500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18500:1876044666863360:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789136138.124964:0:18500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136138.124978:0:18500:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c4ec3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136138.124989:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863360 00000100:00100000:0.0:1789136138.125004:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863360 00000100:00100000:0.0:1789136138.125025:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789136138.125031:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18500:x1876044666863360:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789136138.125057:0:19572:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:0.0:1789136138.141529:0:17733:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1789136138.142753:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.142763:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142782:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.142787:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.142793:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142824:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142835:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142873:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142894:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.142910:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.142915:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142922:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.142926:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142935:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142951:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142959:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007f9425/0x559c8745c6de3fa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.142976:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.142978:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.142980:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.146099:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.146127:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146146:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.146151:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.146158:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146173:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146184:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146192:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146217:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.146242:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.146247:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146255:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.146259:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146268:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146292:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146300:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc3545de/0x559c8745c6de3fb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.146319:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.146321:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.146323:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.147249:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.147257:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.147268:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.147272:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.147277:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.147287:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.147296:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.147303:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.147329:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.147340:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.147345:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.147351:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ec00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.147355:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.149607:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.149644:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.149652:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d28efda/0x559c8745c6de3fb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.149675:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.149677:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.149679:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.153102:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.153117:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.153136:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.153150:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.153158:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.153173:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.153184:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.153191:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.153219:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136138.153295:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136138.153303:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.153311:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136138.153315:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.153325:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.153345:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.153363:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd975615/0x559c8745c6de3fbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.153382:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.153384:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.153386:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.157095:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.157108:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157126:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.157131:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.157138:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157152:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157162:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157178:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157196:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.157209:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.157214:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157222:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.157226:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157236:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157253:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157261:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de3fc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.157276:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.157278:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.157280:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.158086:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.158101:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.158112:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.158117:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.158122:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.158133:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.158142:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.158150:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.158175:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136138.158462:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136138.158469:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.158478:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136138.158482:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.158490:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.158503:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.158512:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de3fcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.158529:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.158531:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.158532:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.160160:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.160171:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160185:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.160190:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.160197:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160209:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160226:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160235:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160250:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.160737:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.160744:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160754:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.160758:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160767:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160783:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160791:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034d01d76/0x559c8745c6de3fd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.160906:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.160915:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.160917:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.162684:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.162696:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.162712:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.162717:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.162724:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.162737:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.162748:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.162756:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.162779:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136138.165346:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136138.165360:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.165374:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136138.165380:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.165392:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.165414:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.165421:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f262408e/0x559c8745c6de3fda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.165442:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.165444:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.165446:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136138.168685:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136138.168700:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.168718:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1789136138.168723:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136138.168730:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.168752:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.168764:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.168772:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.168793:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.169260:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.169266:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.169275:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafc00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.169279:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.169289:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.169306:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.169314:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053b979d0/0x559c8745c6de3fe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.169339:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.169342:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.169344:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136138.177080:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.177095:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.177114:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.177119:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.177126:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.177142:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.177153:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.177161:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.177182:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136138.177345:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136138.177351:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.177359:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136138.179313:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179338:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179358:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179367:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de3fe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179386:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.179388:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.179390:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136138.179568:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.179575:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179586:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.179591:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.179598:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179610:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179620:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179635:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.179654:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136138.181874:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.181887:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.181905:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.181910:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.181916:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.181929:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.181939:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.181947:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.181969:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789136138.182380:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.182387:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182403:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.182407:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.182412:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182422:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182431:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182439:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182449:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789136138.182782:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.182788:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182955:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.182960:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.182968:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.182979:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183009:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183017:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183026:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789136138.183317:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.183323:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183331:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.183334:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.183337:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183346:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183353:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183359:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.183377:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1789136138.184413:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.184422:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.184434:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.184438:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.184724:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.184739:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.184749:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.184757:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.184768:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1789136138.184929:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789136138.184937:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.184945:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.184950:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.184971:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185003:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185012:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de3fef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185035:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789136138.185039:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185045:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.185048:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185056:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185065:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185073:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceba38d4/0x559c8745c6de3ff6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185096:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789136138.185100:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185106:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ca00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.185110:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185118:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185128:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185136:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de3ffd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185148:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136138.185152:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185158:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.185161:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185178:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185190:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185196:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afea8679/0x559c8745c6de4004 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185208:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136138.185211:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185217:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.185220:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185226:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185249:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185255:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fff1fc7/0x559c8745c6de400b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185277:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136138.185281:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185287:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.185290:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185297:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185306:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185314:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ebe25b7/0x559c8745c6de4012 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.185324:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.185326:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.185328:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136138.186435:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.188301:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.188322:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.188338:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.188345:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.188362:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.188373:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.188380:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.188406:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136138.191741:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136138.191755:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.191769:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.191780:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.191794:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.191829:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.191837:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a6fb1d3/0x559c8745c6de4019 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.192029:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.192032:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.192033:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136138.193560:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136138.193571:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.193586:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=586s v=(0 0) 00010000:00010000:1.0:1789136138.193591:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136138.193598:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.193612:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.193621:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.193635:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.193662:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136138.193797:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136138.194055:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.194644:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.194653:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136138.194658:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.194667:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.194684:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.194691:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb0d1c17/0x559c8745c6de4020 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.194707:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.194709:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.194711:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136138.195002:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136138.195009:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195019:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789136138.195023:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136138.195029:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195040:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195060:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195070:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195085:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136138.195211:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136138.195217:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195225:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136138.195228:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195243:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195255:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195263:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de4027 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195277:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.195284:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.195286:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136138.195661:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136138.195667:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195676:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789136138.195679:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136138.195683:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195692:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195700:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195707:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.195725:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136138.196004:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136138.196014:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.196023:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136138.196027:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.196035:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.196048:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.196056:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009f4f6e8/0x559c8745c6de402e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136138.196069:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.196071:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136138.196073:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136138.198425:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136138.198453:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.198471:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789136138.198476:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136138.198483:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.198510:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.198521:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.198530:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.198554:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136138.199049:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136138.199056:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.199065:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4e00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136138.199070:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.199091:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.199108:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.199116:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a8be8f4/0x559c8745c6de4035 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.199135:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.199137:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.199139:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136138.199148:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136138.199154:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.199162:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789136138.199165:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136138.199168:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.199177:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.199184:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.199202:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.199220:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.199665:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.199671:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.199680:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.199683:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.199691:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.199705:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.199712:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6292b74/0x559c8745c6de403c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.199726:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.199728:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.199730:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136138.203328:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136138.203341:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.203357:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=586s v=(0 0) 00010000:00010000:3.0:1789136138.203362:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136138.203368:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.203383:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.203392:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.203413:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.203443:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136138.203587:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.203594:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.203614:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ec00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.203619:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.203629:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.203647:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.203654:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000463d0f59/0x559c8745c6de4043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.203672:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.203674:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.203676:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136138.219039:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136138.219057:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.219075:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789136138.219079:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136138.219085:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.219100:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.219109:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.219116:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.219290:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136138.222304:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136138.222319:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.222348:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=586s v=(0 0) 00010000:00010000:2.0:1789136138.222353:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136138.222361:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.222391:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.222402:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136138.222409:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224765:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136138.224782:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224794:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.224810:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224821:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224878:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224888:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d57b5b09/0x559c8745c6de404a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224955:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.224960:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224966:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.224970:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224977:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.224986:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.225006:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.225007:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.225009:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136138.226013:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789136138.226022:0:19266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060144cff/0x559c8745c6de4051 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136138.229419:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136138.229433:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.229450:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=586s v=(0 0) 00010000:00010000:3.0:1789136138.229456:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136138.229463:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.229479:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.229489:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.229497:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.234739:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136138.234754:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.234783:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136138.234789:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136138.235080:0:20083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789136138.235125:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789136138.235130:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789136138.235305:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:18500:x1876044666863360:12345-0@lo:5:osp-pre-1-1.0 Request processed in 110269us (110336us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789136138.235316:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136138.235376:0:18500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789136138.235385:0:18500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d21c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18500:1876044666863360:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789136138.235411:0:18500:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789136138.235495:0:18500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18500:1876044666863488:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789136138.235534:0:18500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136138.235560:0:18500:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136138.235577:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863488 00000100:00100000:1.0:1789136138.235583:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863488 00000100:00100000:1.0:1789136138.235627:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136138.235635:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18500:x1876044666863488:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789136138.235681:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18500:x1876044666863488:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136138.235688:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789136138.235719:0:18500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c9678780 x1876044666863488/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136154 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136138.235731:0:18500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18500:1876044666863488:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789136138.236920:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.236960:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.236974:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.236976:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136138.236979:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.240189:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789136138.240206:0:19266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31baa1e/0x559c8745c6de4058 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136138.240881:0:19266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136138.240890:0:19266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.240904:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=586s v=(0 0) 00010000:00010000:3.0:1789136138.240910:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136138.240916:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.240931:0:19266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136138.241013:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.249648:0:19266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.249680:0:19266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.249709:0:19266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789136138.249805:0:19266:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1789136138.249923:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17780:x1876044666862848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 139129us (139464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136138.249933:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789136138.250667:0:17780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17780:1876044666862848:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789136138.250683:0:17780:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789136138.250731:0:17780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17780:1876044666863616:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789136138.250773:0:17780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136138.256706:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136138.256721:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.256745:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136138.256750:0:17741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.256761:0:17741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.256783:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.256790:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6a3ce05/0x559c8745c6de405f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136138.256813:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.256815:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136138.256816:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136138.258749:0:17780:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136138.259064:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863616 00000100:00100000:2.0:1789136138.259085:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863616 00000100:00100000:2.0:1789136138.259156:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789136138.259167:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17780:x1876044666863616:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789136138.259216:0:19267:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1789136138.265240:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17780:x1876044666863616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5271us (13662us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789136138.265257:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789136138.265332:0:17780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f660a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17780:1876044666863616:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789136138.265350:0:17780:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1789136138.601321:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136139.113061:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666863744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136139.113132:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136139.113184:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863744 00000100:00100000:2.0:1789136139.113192:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863744 00000100:00100000:2.0:1789136139.113237:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136139.113246:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666863744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136139.113274:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136139.113315:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666863744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136139.113322:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136139.113365:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666863744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136139.631956:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136140.139063:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666863872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136140.139140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136140.139204:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666863872 00000100:00100000:0.0:1789136140.139211:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666863872 00000100:00100000:0.0:1789136140.139264:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136140.139274:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666863872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136140.139302:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136140.139346:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666863872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136140.139353:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136140.139431:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666863872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136140.139694:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666864000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136140.139727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789136140.143387:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136140.149712:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864000 00000100:00100000:3.0:1789136140.149731:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864000 00000100:00100000:3.0:1789136140.149804:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789136140.149815:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666864000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136140.149877:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789136140.149977:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666864000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (10248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136140.149984:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789136140.150042:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666864000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136140.649738:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666864128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136140.649911:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136140.649983:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864128 00000100:00100000:1.0:1789136140.649990:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864128 00000100:00100000:1.0:1789136140.650038:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789136140.650048:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666864128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136140.650084:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136140.650129:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666864128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136140.650155:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789136140.650207:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666864128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789136140.651543:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136140.909550:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789136141.171802:0:20441:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789136141.672200:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789136142.241304:0:20493:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136142.241633:0:20493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136142.696301:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136143.208215:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666864384:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666864896:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208398:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208418:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666865408:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208470:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789136143.208476:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666864256:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208504:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208528:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666864768:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208550:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666865280:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666865792:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208660:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666864512:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208702:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666865024:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208738:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666865536:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208807:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789136143.208812:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666864640:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208851:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666865152:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208894:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208922:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666865664:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.208943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.208971:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864384 00000100:00100000:3.0:1789136143.208980:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864384 00000100:00100000:3.0:1789136143.209016:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864896 00000100:00100000:3.0:1789136143.209019:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864896 00000100:00100000:3.0:1789136143.209034:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789136143.209042:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666864384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209097:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666864384:12345-0@lo:400:kworker.0 Request processed in 54us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209105:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789136143.209123:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789136143.209130:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666864896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209157:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666864896:12345-0@lo:400:kworker.0 Request processed in 29us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209164:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789136143.209183:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865408 00000100:00100000:3.0:1789136143.209187:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865408 00000100:00100000:3.0:1789136143.209215:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864768 00000100:00100000:3.0:1789136143.209218:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864768 00000100:00100000:3.0:1789136143.209227:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865280 00000100:00100000:3.0:1789136143.209236:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865280 00000100:00100000:3.0:1789136143.209251:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865792 00000100:00100000:3.0:1789136143.209253:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865792 00000100:00100000:3.0:1789136143.209265:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865536 00000100:00100000:3.0:1789136143.209267:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865536 00000100:00100000:3.0:1789136143.209280:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865664 00000100:00100000:3.0:1789136143.209282:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865664 00000100:00100000:3.0:1789136143.209297:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136143.209304:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666865408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209336:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666865408:12345-0@lo:400:kworker.0 Request processed in 33us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209342:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136143.209354:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789136143.209360:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666864768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209388:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666864768:12345-0@lo:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209394:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789136143.209406:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789136143.209411:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666865280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209439:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666865280:12345-0@lo:400:kworker.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209445:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789136143.209456:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789136143.209462:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666865792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209486:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666865792:12345-0@lo:400:kworker.0 Request processed in 25us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209492:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789136143.209512:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136143.209519:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666865536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209553:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666865536:12345-0@lo:400:kworker.0 Request processed in 35us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209559:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136143.209570:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136143.209576:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666865664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209604:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666865664:12345-0@lo:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209610:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789136143.209630:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864256 00000100:00100000:3.0:1789136143.209634:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864256 00000100:00100000:3.0:1789136143.209662:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789136143.209668:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:3641:x1876044666864256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209697:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:3641:x1876044666864256:12345-0@lo:400:kworker.0 Request processed in 30us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209704:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789136143.209733:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864512 00000100:00100000:3.0:1789136143.209737:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864512 00000100:00100000:3.0:1789136143.209758:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865024 00000100:00100000:3.0:1789136143.209761:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865024 00000100:00100000:3.0:1789136143.209770:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666864640 00000100:00100000:3.0:1789136143.209772:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666864640 00000100:00100000:3.0:1789136143.209781:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865152 00000100:00100000:3.0:1789136143.209783:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865152 00000100:00100000:3.0:1789136143.209795:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136143.209801:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666864512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209832:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666864512:12345-0@lo:400:kworker.0 Request processed in 31us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209844:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136143.209880:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136143.209886:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666865024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209930:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666865024:12345-0@lo:400:kworker.0 Request processed in 44us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209936:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136143.209950:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136143.209955:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666864640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.209981:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666864640:12345-0@lo:400:kworker.0 Request processed in 26us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.209986:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136143.209996:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136143.210002:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666865152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210044:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666865152:12345-0@lo:400:kworker.0 Request processed in 41us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.210050:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789136143.210074:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136143.210078:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789136143.210081:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136143.210082:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136143.210115:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666864640:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210128:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666865152:0@lo:400:kworker.0 00010000:00080000:3.0:1789136143.210138:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b00780 x1876044666865664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136143.210147:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666865664:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210168:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666864512:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210177:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666865024:0@lo:400:kworker.0 00010000:00080000:3.0:1789136143.210187:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b00f00 x1876044666865536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136143.210194:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666865536:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210236:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666864256:0@lo:400:kworker.0 00010000:00080000:3.0:1789136143.210246:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4763480 x1876044666864768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136143.210254:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666864768:0@lo:400:kworker.0 00010000:00080000:3.0:1789136143.210263:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c47612c0 x1876044666865280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136143.210270:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666865280:0@lo:400:kworker.0 00010000:00080000:3.0:1789136143.210280:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b02580 x1876044666865792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136143.210289:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b02580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666865792:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210299:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666864384:0@lo:400:kworker.0 00000100:00100000:3.0:1789136143.210309:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666864896:0@lo:400:kworker.0 00010000:00080000:3.0:1789136143.210318:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6b01680 x1876044666865408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136143.210325:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666865408:0@lo:400:kworker.0 00000100:00100000:0.0:1789136143.226466:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136143.226495:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666865920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136143.226573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136143.226629:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666865920 00000100:00100000:0.0:1789136143.226638:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666865920 00000100:00100000:0.0:1789136143.226694:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136143.226704:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666865920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136143.226749:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136143.226798:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876044666865920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136143.226805:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136143.226887:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666865920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136143.227659:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136143.227673:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666866048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136143.227713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136143.227972:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866048 00000100:00100000:3.0:1789136143.227978:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866048 00000100:00100000:3.0:1789136143.228019:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136143.228027:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666866048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136143.228044:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136143.228084:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666866048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.228091:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136143.228127:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b01680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666866048:0@lo:13:osp-pre-1-1.0 00000020:00000004:1.0:1789136143.591716:0:20543:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136143.591993:0:20543:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136143.720987:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789136143.727790:0:20083:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1789136143.926079:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136143.926512:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739328 00000100:00100000:1.0:1789136143.926525:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739328 00000100:00100000:1.0:1789136143.926580:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:1.0:1789136143.926589:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2388:x1876044644739328:12345-192.168.201.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789136143.926619:0:17746:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d7d35a68-30a0-4475-a8ab-9673ac334408@192.168.201.31@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:1.0:1789136143.926646:0:17746:0:(genops.c:1385:class_connect()) connect: client d7d35a68-30a0-4475-a8ab-9673ac334408, cookie 0x559c8745c6de4066 00000100:00080000:2.0:1789136143.927996:0:17746:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c43800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136143.928096:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+5:2388:x1876044644739328:12345-192.168.201.31@tcp:250:mount.lustre.0 Request processed in 1504us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136143.928134:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:3.0:1789136143.939509:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136143.939685:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739456 00000100:00100000:1.0:1789136143.939694:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739456 00000100:00100000:1.0:1789136143.939755:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:1.0:1789136143.939765:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+5:15149:x1876044644739456:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789136143.939782:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136143.939800:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167ce00/0x559c8745c6de406d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08d12 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136143.939831:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167ce00/0x559c8745c6de406d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d12 expref: 6 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136143.939843:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167ce00/0x559c8745c6de406d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d12 expref: 6 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136143.939906:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ce00, rc 0) 00000100:00100000:1.0:1789136143.939973:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+6:15149:x1876044644739456:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 209us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136143.939996:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:3.0:1789136143.956636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136143.956921:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739584 00000100:00100000:2.0:1789136143.956931:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739584 00000100:00100000:2.0:1789136143.956992:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:2.0:1789136143.957003:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+6:15149:x1876044644739584:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136143.957152:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+6:15149:x1876044644739584:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 150us (524us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789136143.957160:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:0.0:1789136143.960130:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136143.960285:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739712 00000100:00100000:3.0:1789136143.960294:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739712 00000100:00100000:3.0:1789136143.960350:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:3.0:1789136143.960360:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+6:15149:x1876044644739712:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136143.960386:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136143.960405:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de4074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08d19 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136143.960433:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de4074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d19 expref: 7 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136143.960443:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de4074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d19 expref: 7 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136143.960453:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ea00, rc 0) 00000100:00100000:3.0:1789136143.960529:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+7:15149:x1876044644739712:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 169us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.960536:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:3.0:1789136143.964475:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136143.964944:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739840 00000100:00100000:1.0:1789136143.964965:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739840 00000100:00100000:1.0:1789136143.965026:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:1.0:1789136143.965037:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+7:15149:x1876044644739840:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789136143.965223:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15149:x1876044644739840:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 187us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136143.965231:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:0.0:1789136143.970373:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136143.971563:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644739968 00000100:00100000:2.0:1789136143.971575:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644739968 00000100:00100000:2.0:1789136143.971657:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:2.0:1789136143.971668:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15149:x1876044644739968:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789136143.971837:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15149:x1876044644739968:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 170us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136143.971845:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:0.0:1789136143.986246:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136143.986343:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740096 00000100:00100000:3.0:1789136143.986352:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740096 00000100:00100000:3.0:1789136143.986422:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:3.0:1789136143.986432:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15168:x1876044644740096:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136143.986610:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15168:x1876044644740096:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 179us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136143.986619:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:0.0:1789136144.027148:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136144.027380:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740224 00000100:00100000:3.0:1789136144.027395:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740224 00000100:00100000:3.0:1789136144.027478:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:3.0:1789136144.027491:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15168:x1876044644740224:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136144.027704:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15168:x1876044644740224:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 216us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136144.027711:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:0.0:1789136144.035310:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136144.035670:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740352 00000100:00100000:2.0:1789136144.035684:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740352 00000100:00100000:2.0:1789136144.035755:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:2.0:1789136144.035767:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15168:x1876044644740352:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136144.036055:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15168:x1876044644740352:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 290us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136144.036065:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:1.0:1789136144.043482:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.043912:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740480 00000100:00100000:0.0:1789136144.043926:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740480 00000100:00100000:0.0:1789136144.044004:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1789136144.044016:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+8:15149:x1876044644740480:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789136144.044039:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136144.044062:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de407b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08d4a expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136144.044101:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de407b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d4a expref: 9 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136144.044113:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de407b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d4a expref: 9 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136144.044125:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf800, rc 0) 00000100:00100000:0.0:1789136144.044332:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+9:15149:x1876044644740480:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 317us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.044340:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1789136144.055089:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136144.055198:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740608 00000100:00100000:3.0:1789136144.055211:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740608 00000100:00100000:3.0:1789136144.055323:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:3.0:1789136144.055334:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+9:15149:x1876044644740608:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789136144.055373:0:17747:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789136144.055406:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789136144.055409:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789136144.055412:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789136144.055418:0:17747:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789136144.055420:0:17747:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789136144.057463:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+9:15149:x1876044644740608:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 2112us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.057481:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:1.0:1789136144.065124:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.065244:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740736 00000100:00100000:0.0:1789136144.065260:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740736 00000100:00100000:0.0:1789136144.065577:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:0.0:1789136144.065595:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f528e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+9:15149:x1876044644740736:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789136144.065619:0:17745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136144.065646:0:17745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08d51 expref: -99 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136144.065688:0:17745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 10 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136144.065721:0:17745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 10 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136144.065733:0:17745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae200, rc 0) 00000100:00100000:0.0:1789136144.065925:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f528e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15149:x1876044644740736:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 334us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.066227:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:0.0:1789136144.069974:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136144.070080:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740864 00000100:00100000:1.0:1789136144.070092:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740864 00000100:00100000:1.0:1789136144.070189:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:1.0:1789136144.070199:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15149:x1876044644740864:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789136144.070459:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15149:x1876044644740864:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 260us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.070469:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:3.0:1789136144.072136:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.072203:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644740992 00000100:00100000:0.0:1789136144.072211:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644740992 00000100:00100000:0.0:1789136144.072304:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:0.0:1789136144.072313:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15149:x1876044644740992:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789136144.072520:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15149:x1876044644740992:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 206us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.072530:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:0.0:1789136144.075436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136144.075993:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741120 00000100:00100000:1.0:1789136144.076009:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741120 00000100:00100000:1.0:1789136144.076088:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:1.0:1789136144.076098:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15175:x1876044644741120:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789136144.076300:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15175:x1876044644741120:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 202us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.076311:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:3.0:1789136144.079117:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.079656:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741248 00000100:00100000:0.0:1789136144.079669:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741248 00000100:00100000:0.0:1789136144.079805:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:0.0:1789136144.079815:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15175:x1876044644741248:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136144.080077:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15175:x1876044644741248:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 261us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.080087:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:3.0:1789136144.088288:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136144.088407:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136144.088787:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741376 00000100:00100000:1.0:1789136144.088801:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741376 00000100:00100000:1.0:1789136144.088912:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741632 00000100:00100000:1.0:1789136144.088915:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741632 00000100:00100000:1.0:1789136144.088936:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1789136144.088944:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876044644741376:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789136144.088980:0:18920:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 8615a57a-8113-4aad-917f-27cc7b9dd43a@192.168.201.31@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:1.0:1789136144.089038:0:18920:0:(genops.c:1385:class_connect()) connect: client 8615a57a-8113-4aad-917f-27cc7b9dd43a, cookie 0x559c8745c6de4089 00000004:00100000:1.0:1789136144.089073:0:18920:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789136144.089329:0:18920:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c42000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136144.089418:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2388:x1876044644741376:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 472us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.089427:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1789136144.089455:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1789136144.089460:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1876044644741632:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789136144.089476:0:18920:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 8615a57a-8113-4aad-917f-27cc7b9dd43a@192.168.201.31@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:1.0:1789136144.090077:0:18920:0:(genops.c:1385:class_connect()) connect: client 8615a57a-8113-4aad-917f-27cc7b9dd43a, cookie 0x559c8745c6de4090 00000004:00100000:1.0:1789136144.090099:0:18920:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789136144.090835:0:18920:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c43000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136144.090951:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2388:x1876044644741632:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 1487us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.090961:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1789136144.103355:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136144.103413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136144.103601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.109925:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741888 00000100:00100000:0.0:1789136144.109971:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741888 00000100:00100000:2.0:1789136144.110087:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741760 00000100:00100000:2.0:1789136144.110094:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741760 00000100:00100000:0.0:1789136144.110202:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644741504 00000100:00100000:0.0:1789136144.110207:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644741504 00000100:00100000:0.0:1789136144.110233:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136144.110244:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15149:x1876044644741888:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136144.110301:0:17755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789136144.110444:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15149:x1876044644741888:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 200us (7108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.110452:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136144.110476:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789136144.110484:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:0:x1876044644741504:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136144.110497:0:17755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789136144.110521:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:0:x1876044644741504:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 38us (6920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.110528:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00080000:3.0:1789136144.114463:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136144.114477:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136144.117102:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136144.117950:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742016 00000100:00100000:3.0:1789136144.117967:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742016 00000100:00100000:3.0:1789136144.118056:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:3.0:1789136144.118068:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15149:x1876044644742016:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789136144.118331:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15149:x1876044644742016:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 263us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136144.118340:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1789136144.120955:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1789136144.120980:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:0:x1876044644741760:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789136144.121029:0:17754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136144.121159:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:0:x1876044644741760:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 191us (17746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136144.121165:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:0.0:1789136144.129960:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.130009:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.130055:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136144.130179:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742400 00000100:00100000:1.0:1789136144.130193:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742400 00000100:00100000:1.0:1789136144.130274:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:3.0:1789136144.130282:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742144 00000100:00100000:3.0:1789136144.130286:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742144 00000100:00100000:1.0:1789136144.130287:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15149:x1876044644742400:12345-192.168.201.31@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789136144.130313:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742272 00000100:00100000:3.0:1789136144.130316:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742272 00000100:00100000:3.0:1789136144.130333:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:3.0:1789136144.130339:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644742144:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789136144.130374:0:19572:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 8615a57a-8113-4aad-917f-27cc7b9dd43a@192.168.201.31@tcp t0 exp 0000000000000000 cur 592 last 0 00000100:00100000:1.0:1789136144.130399:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15149:x1876044644742400:12345-192.168.201.31@tcp:900:mount.lustre.0 Request processed in 115us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.130407:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000020:00000080:3.0:1789136144.130417:0:19572:0:(genops.c:1385:class_connect()) connect: client 8615a57a-8113-4aad-917f-27cc7b9dd43a, cookie 0x559c8745c6de4097 00002000:00100000:3.0:1789136144.130445:0:19572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8615a57a-8113-4aad-917f-27cc7b9dd43a/ffff90a7d0675000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789136144.130486:0:19572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789136144.130720:0:19572:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789136144.130759:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a7d0673800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136144.130816:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2388:x1876044644742144:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 468us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136144.130825:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:3.0:1789136144.130843:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1789136144.130848:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644742272:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789136144.130901:0:19572:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 8615a57a-8113-4aad-917f-27cc7b9dd43a@192.168.201.31@tcp t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1789136144.130935:0:19572:0:(genops.c:1385:class_connect()) connect: client 8615a57a-8113-4aad-917f-27cc7b9dd43a, cookie 0x559c8745c6de409e 00002000:00100000:3.0:1789136144.130942:0:19572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8615a57a-8113-4aad-917f-27cc7b9dd43a/ffff90a7d0670000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789136144.130950:0:19572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789136144.131076:0:19572:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789136144.131095:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a7c6311000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136144.131139:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2388:x1876044644742272:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 289us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136144.131146:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:1.0:1789136144.140256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136144.140586:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742528 00000100:00100000:0.0:1789136144.140599:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742528 00000100:00100000:0.0:1789136144.141030:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1789136144.141060:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15149:x1876044644742528:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789136144.143223:0:17756:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2030us 00000004:00200000:0.0:1789136144.164005:0:17756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789136144.165634:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15149:x1876044644742528:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 24571us (25376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136144.165679:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1789136144.233769:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666866176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136144.233932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136144.234235:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866176 00000100:00100000:1.0:1789136144.234246:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866176 00000100:00100000:1.0:1789136144.234327:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136144.234340:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666866176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136144.234372:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136144.234484:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666866176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.234492:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789136144.236132:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666866176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136144.356334:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136144.372030:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742656 00000100:00100000:1.0:1789136144.372055:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742656 00000100:00100000:1.0:1789136144.372147:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1789136144.372159:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15200:x1876044644742656:12345-192.168.201.31@tcp:101:mkdir.0 00010000:00010000:1.0:1789136144.372181:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136144.372210:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de40a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08d82 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136144.372280:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de40ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136144.372309:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de40ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136144.372336:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de40ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136144.372390:0:18920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789136144.372395:0:18920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789136144.372433:0:18920:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de40ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136144.372461:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de40a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d82 expref: 8 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136144.372480:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de40ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d82 expref: 7 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136144.372488:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:1.0:1789136144.372491:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136144.372494:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ca00, rc 0) 00000100:00100000:1.0:1789136144.372574:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15200:x1876044644742656:12345-192.168.201.31@tcp:101:mkdir.0 Request processed in 417us (16264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136144.372582:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00010000:00010000:3.0:1789136144.747982:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136145.256294:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666866304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136145.256391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136145.256683:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866304 00000100:00100000:0.0:1789136145.256693:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866304 00000100:00100000:0.0:1789136145.256756:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136145.256767:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666866304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136145.256796:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136145.256849:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666866304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136145.256888:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789136145.257340:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136145.257390:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666866304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136145.258300:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136145.258315:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666866432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136145.258380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136145.259105:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866432 00000100:00100000:3.0:1789136145.259123:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866432 00000100:00100000:3.0:1789136145.259181:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136145.259191:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666866432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136145.259243:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789136145.259308:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666866432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136145.259315:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789136145.259433:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666866432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136145.768406:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666866560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136145.768477:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136145.768572:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866560 00000100:00100000:2.0:1789136145.768582:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866560 00000100:00100000:2.0:1789136145.768647:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789136145.768658:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666866560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136145.768694:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136145.768748:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666866560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136145.768756:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789136145.768804:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666866560:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136145.772053:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136146.538913:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789136146.752958:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136146.753063:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742784 00000100:00100000:2.0:1789136146.753073:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742784 00000100:00100000:2.0:1789136146.753162:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136146.753176:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15253:x1876044644742784:12345-192.168.201.31@tcp:41:lfs.0 00000004:00000024:2.0:1789136146.753248:0:17754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789136146.753343:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15253:x1876044644742784:12345-192.168.201.31@tcp:41:lfs.0 Request processed in 171us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136146.753351:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00080000:3.0:1789136146.753475:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136146.762666:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136146.763663:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644742912 00000100:00100000:1.0:1789136146.763675:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644742912 00000100:00100000:1.0:1789136146.763765:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:1.0:1789136146.763782:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15253:x1876044644742912:12345-192.168.201.31@tcp:41:lfs.0 00000004:00000024:1.0:1789136146.763825:0:18920:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136146.763983:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15253:x1876044644742912:12345-192.168.201.31@tcp:41:lfs.0 Request processed in 208us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136146.763991:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00080000:3.0:1789136146.764355:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136146.769013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136146.769158:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743040 00000100:00100000:2.0:1789136146.769172:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743040 00000100:00100000:2.0:1789136146.769271:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1789136146.769285:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15253:x1876044644743040:12345-192.168.201.31@tcp:13:lfs.0 00002000:00000024:2.0:1789136146.769330:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789136146.769457:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15253:x1876044644743040:12345-192.168.201.31@tcp:13:lfs.0 Request processed in 176us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136146.769465:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00080000:3.0:1789136146.769807:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136146.779446:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136146.779658:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743168 00000100:00100000:0.0:1789136146.779673:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743168 00000100:00100000:0.0:1789136146.779775:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789136146.779786:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15253:x1876044644743168:12345-192.168.201.31@tcp:13:lfs.0 00002000:00000024:0.0:1789136146.779897:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136146.780017:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15253:x1876044644743168:12345-192.168.201.31@tcp:13:lfs.0 Request processed in 233us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136146.780026:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00080000:3.0:1789136146.780230:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789136146.793702:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136147.048050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.048266:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743296 00000100:00100000:2.0:1789136147.048281:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743296 00000100:00100000:2.0:1789136147.048354:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:2.0:1789136147.048368:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+10:15286:x1876044644743296:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136147.048393:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136147.048418:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5400/0x559c8745c6de40b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08d89 expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.048462:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5400/0x559c8745c6de40b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d89 expref: 11 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.048476:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5400/0x559c8745c6de40b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d89 expref: 11 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.048501:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5400, rc 0) 00000100:00100000:2.0:1789136147.048581:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15286:x1876044644743296:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 214us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.048589:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:2.0:1789136147.055132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.055288:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743424 00000100:00100000:0.0:1789136147.055303:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743424 00000100:00100000:0.0:1789136147.055379:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:0.0:1789136147.055392:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15286:x1876044644743424:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789136147.055647:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15286:x1876044644743424:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 257us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.055657:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:2.0:1789136147.068286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136147.068395:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743552 00000100:00100000:1.0:1789136147.068409:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743552 00000100:00100000:1.0:1789136147.068487:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:1.0:1789136147.068499:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15286:x1876044644743552:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789136147.068738:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15286:x1876044644743552:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 240us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136147.068747:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:1.0:1789136147.104174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.104357:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743680 00000100:00100000:2.0:1789136147.104371:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743680 00000100:00100000:2.0:1789136147.104460:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:2.0:1789136147.104473:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15292:x1876044644743680:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136147.104728:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15292:x1876044644743680:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 256us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.104737:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:2.0:1789136147.146263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.146845:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743808 00000100:00100000:0.0:1789136147.146912:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743808 00000100:00100000:0.0:1789136147.146994:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:0.0:1789136147.147006:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff57d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15292:x1876044644743808:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136147.147240:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff57d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15292:x1876044644743808:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 235us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.147249:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:3.0:1789136147.161471:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136147.162197:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644743936 00000100:00100000:1.0:1789136147.162215:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644743936 00000100:00100000:1.0:1789136147.162308:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:1.0:1789136147.162322:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15292:x1876044644743936:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789136147.162558:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15292:x1876044644743936:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 237us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136147.162568:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:1.0:1789136147.170153:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.170339:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744064 00000100:00100000:2.0:1789136147.170354:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744064 00000100:00100000:2.0:1789136147.170439:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:2.0:1789136147.170452:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15286:x1876044644744064:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136147.170477:0:17746:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136147.170503:0:17746:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5000/0x559c8745c6de40ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08dba expref: -99 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.170542:0:17746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5000/0x559c8745c6de40ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dba expref: 12 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.170580:0:17746:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5000/0x559c8745c6de40ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dba expref: 12 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.170592:0:17746:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5000, rc 0) 00000100:00100000:2.0:1789136147.170673:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15286:x1876044644744064:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 222us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.170682:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:2.0:1789136147.182157:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.182806:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744192 00000100:00100000:0.0:1789136147.182822:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744192 00000100:00100000:0.0:1789136147.182946:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00100000:0.0:1789136147.182959:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15286:x1876044644744192:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789136147.182997:0:17745:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789136147.183033:0:17745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789136147.183038:0:17745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789136147.183042:0:17745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789136147.183045:0:17745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789136147.183048:0:17745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789136147.195477:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15286:x1876044644744192:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 12497us (13314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.195520:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00100000:3.0:1789136147.207488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136147.210724:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744320 00000100:00100000:1.0:1789136147.210748:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744320 00000100:00100000:1.0:1789136147.210930:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:1.0:1789136147.210945:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15286:x1876044644744320:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789136147.210968:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136147.210999:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08dc1 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136147.211081:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 13 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136147.211096:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 13 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136147.211108:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d800, rc 0) 00000100:00100000:1.0:1789136147.211206:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15286:x1876044644744320:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 263us (3735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136147.211214:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:2.0:1789136147.222387:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.222523:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744448 00000100:00100000:0.0:1789136147.222536:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744448 00000100:00100000:0.0:1789136147.222610:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:0.0:1789136147.222621:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15286:x1876044644744448:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789136147.222901:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15286:x1876044644744448:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 280us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.222911:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:3.0:1789136147.227520:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.227754:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744576 00000100:00100000:2.0:1789136147.227768:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744576 00000100:00100000:2.0:1789136147.227891:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:2.0:1789136147.227907:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15286:x1876044644744576:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789136147.228145:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15286:x1876044644744576:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 241us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.228156:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:3.0:1789136147.232227:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136147.240626:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744704 00000100:00100000:1.0:1789136147.240651:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744704 00000100:00100000:2.0:1789136147.241005:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:2.0:1789136147.241019:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15295:x1876044644744704:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136147.241613:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15295:x1876044644744704:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 583us (9391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.241624:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:3.0:1789136147.249147:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.249516:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744832 00000100:00100000:0.0:1789136147.249529:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744832 00000100:00100000:2.0:1789136147.249689:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:2.0:1789136147.249718:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15295:x1876044644744832:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136147.249976:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15295:x1876044644744832:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 275us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.249986:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:3.0:1789136147.264063:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136147.264308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.265216:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644744960 00000100:00100000:0.0:1789136147.265232:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644744960 00000100:00100000:0.0:1789136147.265295:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745216 00000100:00100000:0.0:1789136147.265299:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745216 00000100:00100000:0.0:1789136147.265335:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789136147.265345:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1876044644744960:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789136147.265385:0:17753:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 2a472c6c-d1e0-40bc-9d80-35f3f0adb443@192.168.201.31@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:0.0:1789136147.265500:0:17753:0:(genops.c:1385:class_connect()) connect: client 2a472c6c-d1e0-40bc-9d80-35f3f0adb443, cookie 0x559c8745c6de40c8 00000004:00100000:0.0:1789136147.265541:0:17753:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789136147.266998:0:17753:0:(import.c:65:import_set_state_nolock()) ffff90a7fa373000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136147.267213:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1789136147.267224:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876044644745216:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136147.267261:0:17755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 2a472c6c-d1e0-40bc-9d80-35f3f0adb443@192.168.201.31@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:3.0:1789136147.267306:0:17755:0:(genops.c:1385:class_connect()) connect: client 2a472c6c-d1e0-40bc-9d80-35f3f0adb443, cookie 0x559c8745c6de40cf 00000004:00100000:3.0:1789136147.267339:0:17755:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789136147.267496:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2388:x1876044644744960:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 2149us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136147.267505:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00080000:3.0:1789136147.286152:0:17755:0:(import.c:65:import_set_state_nolock()) ffff90a7c6317000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136147.286270:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2388:x1876044644745216:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 19040us (21956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136147.286285:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1789136147.286717:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136147.286768:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.286933:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745088 00000100:00100000:2.0:1789136147.286945:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745088 00000100:00100000:2.0:1789136147.287025:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745472 00000100:00100000:2.0:1789136147.287029:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745472 00000100:00100000:2.0:1789136147.287052:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789136147.287075:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+7:0:x1876044644745088:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789136147.287119:0:17754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789136147.287175:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9679e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+7:0:x1876044644745088:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.287183:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789136147.287201:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1789136147.287208:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644745472:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789136147.287221:0:17754:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789136147.287244:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644745472:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 37us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.287251:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00080000:1.0:1789136147.287810:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136147.302171:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.302585:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745600 00000100:00100000:2.0:1789136147.302599:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745600 00000100:00100000:2.0:1789136147.302687:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:2.0:1789136147.302710:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644745600:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789136147.302890:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644745600:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 154us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.302923:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789136147.312781:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.312912:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.312937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136147.313206:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745728 00000100:00100000:3.0:1789136147.313221:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745728 00000100:00100000:3.0:1789136147.313272:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745856 00000100:00100000:3.0:1789136147.313276:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745856 00000100:00100000:3.0:1789136147.313300:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789136147.313311:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644745728:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789136147.313373:0:19572:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2a472c6c-d1e0-40bc-9d80-35f3f0adb443@192.168.201.31@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:3.0:1789136147.313433:0:19572:0:(genops.c:1385:class_connect()) connect: client 2a472c6c-d1e0-40bc-9d80-35f3f0adb443, cookie 0x559c8745c6de40d6 00002000:00100000:3.0:1789136147.313451:0:19572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2a472c6c-d1e0-40bc-9d80-35f3f0adb443/ffff90a7d26b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789136147.313465:0:19572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789136147.313582:0:19572:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789136147.313649:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a7fa378000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136147.313760:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2388:x1876044644745728:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 448us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136147.313769:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789136147.313794:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:3.0:1789136147.313800:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644745856:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789136147.313845:0:19572:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2a472c6c-d1e0-40bc-9d80-35f3f0adb443@192.168.201.31@tcp t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:3.0:1789136147.313897:0:19572:0:(genops.c:1385:class_connect()) connect: client 2a472c6c-d1e0-40bc-9d80-35f3f0adb443, cookie 0x559c8745c6de40dd 00002000:00100000:3.0:1789136147.313904:0:19572:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2a472c6c-d1e0-40bc-9d80-35f3f0adb443/ffff90a7fa379800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789136147.313915:0:19572:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789136147.313967:0:19572:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789136147.313984:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a7fa378800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136147.314370:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136147.314880:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745344 00000100:00100000:0.0:1789136147.314889:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745344 00000100:00100000:0.0:1789136147.314954:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789136147.314963:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:0:x1876044644745344:12345-192.168.201.31@tcp:41:mount.lustre.0 00000100:00100000:1.0:1789136147.315130:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644745984 00000100:00100000:1.0:1789136147.315136:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644745984 00000100:00100000:1.0:1789136147.315180:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1789136147.315188:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644745984:12345-192.168.201.31@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789136147.315273:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644745984:12345-192.168.201.31@tcp:900:mount.lustre.0 Request processed in 86us (2361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136147.315282:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00080000:1.0:1789136147.315336:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136147.316446:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2388:x1876044644745856:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 2635us (3498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136147.316479:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000004:00000024:0.0:1789136147.316590:0:17753:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136147.317595:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:0:x1876044644745344:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 2622us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136147.317608:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1789136147.331731:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136147.331954:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746112 00000100:00100000:1.0:1789136147.331968:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746112 00000100:00100000:1.0:1789136147.332031:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:1.0:1789136147.332043:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644746112:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789136147.332161:0:17757:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789136147.332305:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15286:x1876044644746112:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 264us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136147.332314:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:1.0:1789136147.612024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136147.612179:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746240 00000100:00100000:2.0:1789136147.612193:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746240 00000100:00100000:2.0:1789136147.612278:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136147.612291:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15320:x1876044644746240:12345-192.168.201.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789136147.612318:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136147.612369:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de40e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08df2 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.612469:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.612488:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.612505:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136147.612573:0:17754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136147.612578:0:17754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136147.612607:0:17754:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.612641:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4800/0x559c8745c6de40e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 8 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.612666:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 7 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136147.613254:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:2.0:1789136147.613258:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136147.613262:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4e00, rc 0) 00000100:00100000:2.0:1789136147.613959:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+7:15320:x1876044644746240:12345-192.168.201.31@tcp:101:mkdir.0 Request processed in 1662us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136147.613971:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00010000:00010000:3.0:1789136147.816765:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136148.328236:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136148.328289:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666866688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136148.328403:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136148.329231:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866688 00000100:00100000:3.0:1789136148.329260:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866688 00000100:00100000:3.0:1789136148.329360:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789136148.329374:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666866688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136148.329422:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136148.329505:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666866688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136148.329514:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789136148.329768:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136148.329879:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666866688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136148.330416:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666867200:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.330527:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666867712:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.330579:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666868224:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.330631:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789136148.330637:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666867072:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.330677:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666867584:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.330717:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666868096:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.330770:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867712 00000100:00100000:1.0:1789136148.330777:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867712 00000100:00100000:1.0:1789136148.330839:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868224 00000100:00100000:1.0:1789136148.330842:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868224 00000100:00100000:1.0:1789136148.330912:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868096 00000100:00100000:1.0:1789136148.330915:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868096 00000100:00100000:1.0:1789136148.330938:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136148.330947:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666867712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.330999:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666867712:12345-0@lo:400:kworker.0 Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136148.331007:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136148.331026:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136148.331032:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666868224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.331061:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666868224:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136148.331066:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136148.331077:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136148.331083:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666868096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.331109:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666868096:12345-0@lo:400:kworker.0 Request processed in 26us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136148.331114:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136148.331156:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666868096:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.331168:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666867712:0@lo:400:kworker.0 00010000:00080000:1.0:1789136148.331180:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5d6d00 x1876044666868224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136148.331191:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666868224:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331600:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666866816:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.331697:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666867328:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.331744:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666867840:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.331799:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789136148.331807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666866944:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.331887:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c967bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666867456:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.331930:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666867968:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.331956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136148.331982:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866944 00000100:00100000:0.0:1789136148.331987:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866944 00000100:00100000:0.0:1789136148.332018:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867456 00000100:00100000:0.0:1789136148.332021:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867456 00000100:00100000:0.0:1789136148.332038:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136148.332045:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666866944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332091:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666866944:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136148.332113:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136148.332134:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136148.332140:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666867456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332171:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666867456:12345-0@lo:400:kworker.0 Request processed in 32us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136148.332177:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136148.332196:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867328 00000100:00100000:0.0:1789136148.332200:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867328 00000100:00100000:0.0:1789136148.332218:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867840 00000100:00100000:0.0:1789136148.332220:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867840 00000100:00100000:0.0:1789136148.332237:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867968 00000100:00100000:0.0:1789136148.332421:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867968 00000100:00100000:0.0:1789136148.332448:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789136148.332455:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332503:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666867328:12345-0@lo:400:kworker.0 Request processed in 48us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136148.332510:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789136148.332522:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789136148.332529:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666867840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332558:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666867840:12345-0@lo:400:kworker.0 Request processed in 30us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136148.332564:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789136148.332575:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789136148.332581:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666867968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332608:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666867968:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136148.332624:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789136148.332666:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666866944:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332676:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666867456:0@lo:400:kworker.0 00010000:00080000:0.0:1789136148.332688:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3e3e940 x1876044666867968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136148.332699:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666867968:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332713:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666867328:0@lo:400:kworker.0 00000100:00100000:0.0:1789136148.332724:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3e3cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666867840:0@lo:400:kworker.0 00000100:00100000:2.0:1789136148.333029:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867200 00000100:00100000:2.0:1789136148.333034:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867200 00000100:00100000:2.0:1789136148.333073:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867072 00000100:00100000:2.0:1789136148.333077:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867072 00000100:00100000:2.0:1789136148.333096:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666867584 00000100:00100000:2.0:1789136148.333099:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666867584 00000100:00100000:2.0:1789136148.333115:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136148.333123:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666867200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136148.333178:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666867200:12345-0@lo:400:kworker.0 Request processed in 57us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136148.333185:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136148.333200:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136148.333206:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666867072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136148.333237:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666867072:12345-0@lo:400:kworker.0 Request processed in 31us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136148.333269:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136148.333282:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136148.333289:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666867584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136148.333323:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666867584:12345-0@lo:400:kworker.0 Request processed in 36us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136148.333330:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789136148.333359:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136148.333364:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136148.333367:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789136148.333370:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136148.333606:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666868352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136148.333648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136148.333989:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c967b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666867072:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.334004:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666867584:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.334028:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789136148.334047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666867200:0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.334085:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666866816 00000100:00100000:1.0:1789136148.334091:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666866816 00000100:00100000:1.0:1789136148.334139:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789136148.334147:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3640:x1876044666866816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136148.334192:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3640:x1876044666866816:12345-0@lo:400:kworker.0 Request processed in 47us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136148.334199:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789136148.335024:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868352 00000100:00100000:2.0:1789136148.335034:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868352 00000100:00100000:2.0:1789136148.335085:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789136148.335093:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666868352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789136148.335142:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136148.335202:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666868352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136148.335210:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136148.336015:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666868352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136148.336037:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9679680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666866816:0@lo:400:kworker.0 00010000:00010000:0.0:1789136148.840400:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136149.353525:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136149.353560:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666868480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136149.353677:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136149.365629:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868480 00000100:00100000:2.0:1789136149.365653:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868480 00000100:00100000:1.0:1789136149.366221:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136149.366237:0:19268:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789136149.366237:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666868480:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136149.366250:0:19268:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789136149.366305:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136149.366664:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666868480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 429us (12986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136149.366674:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789136149.369752:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666868480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789136149.865151:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789136149.878256:0:18489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:3.0:1789136149.878269:0:18489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000001:00100000:2.0:1789136149.880550:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:2.0:1789136149.880563:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000001:00100000:2.0:1789136149.881079:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:2.0:1789136149.881086:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000001:00100000:3.0:1789136149.890666:0:17733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:3.0:1789136149.890679:0:17733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000040:00080000:0.0:1789136150.125312:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789136150.376396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666868608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136150.376479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136150.376592:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868608 00000100:00100000:0.0:1789136150.376601:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868608 00000100:00100000:0.0:1789136150.376662:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136150.376674:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666868608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136150.376701:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136150.376764:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666868608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.376784:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136150.376887:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666868736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136150.376925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136150.377020:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868736 00000100:00100000:0.0:1789136150.377025:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868736 00000100:00100000:0.0:1789136150.377059:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789136150.377066:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666868736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136150.377096:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789136150.377143:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666868736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136150.377150:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136150.377299:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666868736:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789136150.377367:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136150.377395:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666868608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136150.891107:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136150.891135:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666868864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136150.891224:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789136150.891438:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136150.891493:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868864 00000100:00100000:2.0:1789136150.891502:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868864 00000100:00100000:2.0:1789136150.891565:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789136150.891591:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666868864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136150.891628:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136150.891691:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666868864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136150.891698:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789136150.893637:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666868864:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136151.914381:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136152.060714:0:20642:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789136152.565308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565355:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565408:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565483:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565504:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565537:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565582:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136152.565608:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746624 00000100:00100000:2.0:1789136152.565617:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746624 00000100:00100000:2.0:1789136152.565677:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747136 00000100:00100000:2.0:1789136152.565680:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747136 00000100:00100000:2.0:1789136152.565696:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746496 00000100:00100000:2.0:1789136152.565698:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746496 00000100:00100000:2.0:1789136152.565709:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747008 00000100:00100000:2.0:1789136152.565711:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747008 00000100:00100000:2.0:1789136152.565728:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:2.0:1789136152.565771:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2389:x1876044644746624:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136152.565845:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2389:x1876044644746624:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 77us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136152.565898:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:2.0:1789136152.565920:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1789136152.565944:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644747136:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136152.565974:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644747136:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136152.565982:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:1.0:1789136152.565992:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1789136152.566003:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:1.0:1789136152.566008:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2389:x1876044644746496:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136152.566017:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2389:x1876044644747008:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136152.566044:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2389:x1876044644746496:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 42us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136152.566054:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2389:x1876044644747008:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 39us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136152.566062:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1789136152.566070:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:2.0:1789136152.566098:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746880 00000100:00100000:2.0:1789136152.566102:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746880 00000100:00100000:2.0:1789136152.566128:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747392 00000100:00100000:2.0:1789136152.566131:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747392 00000100:00100000:2.0:1789136152.566152:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746752 00000100:00100000:2.0:1789136152.566155:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746752 00000100:00100000:2.0:1789136152.566167:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747264 00000100:00100000:2.0:1789136152.566169:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747264 00000100:00100000:2.0:1789136152.566184:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789136152.566191:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2389:x1876044644746880:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136152.566262:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1789136152.566271:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644747392:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136152.566316:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2389:x1876044644746880:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136152.566323:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789136152.566336:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1789136152.566342:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c52f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2389:x1876044644746752:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136152.566417:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644746368 00000100:00100000:0.0:1789136152.566422:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644746368 00000100:00100000:0.0:1789136152.566454:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:0.0:1789136152.566461:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2389:x1876044644746368:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136152.568017:0:19267:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789136152.568034:0:19267:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789136152.568174:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789136152.568190:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644747264:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136152.568256:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644747264:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 70us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136152.568265:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00080000:1.0:1789136152.568376:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136152.568383:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136152.568386:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136152.568389:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136152.569499:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644747392:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 3220us (4023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136152.569512:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136152.570500:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c52f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2389:x1876044644746752:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 4150us (4986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136152.570689:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1789136152.571953:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2389:x1876044644746368:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 5484us (6649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136152.571967:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 146 00010000:00010000:0.0:1789136152.936125:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136153.448135:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666868992:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448230:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448287:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666869504:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448337:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666870016:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448380:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666870528:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448403:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448430:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789136153.448436:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666869376:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448494:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666869888:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448532:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666870400:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448597:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666869120:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448646:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666869632:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448688:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666870144:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448734:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789136153.448740:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666869248:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448780:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666869760:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448819:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666870272:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.448839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.448900:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666868992 00000100:00100000:1.0:1789136153.448908:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666868992 00000100:00100000:1.0:1789136153.448955:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789136153.448966:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:3641:x1876044666868992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449018:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:3641:x1876044666868992:12345-0@lo:400:kworker.0 Request processed in 55us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449036:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789136153.449071:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869504 00000100:00100000:1.0:1789136153.449075:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869504 00000100:00100000:1.0:1789136153.449094:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870016 00000100:00100000:1.0:1789136153.449096:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870016 00000100:00100000:1.0:1789136153.449108:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870528 00000100:00100000:1.0:1789136153.449110:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870528 00000100:00100000:1.0:1789136153.449132:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870400 00000100:00100000:1.0:1789136153.449136:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870400 00000100:00100000:1.0:1789136153.449148:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870144 00000100:00100000:1.0:1789136153.449150:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870144 00000100:00100000:1.0:1789136153.449179:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870272 00000100:00100000:1.0:1789136153.449182:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870272 00000100:00100000:1.0:1789136153.449197:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136153.449203:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666869504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449238:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666869504:12345-0@lo:400:kworker.0 Request processed in 35us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449245:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136153.449259:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789136153.449265:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666870016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449293:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666870016:12345-0@lo:400:kworker.0 Request processed in 28us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449299:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789136153.449311:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789136153.449317:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666870528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449345:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666870528:12345-0@lo:400:kworker.0 Request processed in 28us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449351:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789136153.449374:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136153.449380:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666870400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449409:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666870400:12345-0@lo:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449415:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136153.449425:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136153.449431:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666870144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449460:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666870144:12345-0@lo:400:kworker.0 Request processed in 29us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449467:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136153.449478:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136153.449484:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666870272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449512:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666870272:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449518:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136153.449547:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869376 00000100:00100000:1.0:1789136153.449551:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869376 00000100:00100000:1.0:1789136153.449577:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869888 00000100:00100000:1.0:1789136153.449580:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869888 00000100:00100000:1.0:1789136153.449594:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869248 00000100:00100000:1.0:1789136153.449597:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869248 00000100:00100000:1.0:1789136153.449611:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869760 00000100:00100000:1.0:1789136153.449614:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869760 00000100:00100000:1.0:1789136153.449627:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136153.449634:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666869376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449666:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666869376:12345-0@lo:400:kworker.0 Request processed in 33us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449682:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136153.449694:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136153.449700:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666869888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449746:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f660a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666869888:12345-0@lo:400:kworker.0 Request processed in 46us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449753:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136153.449765:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136153.449772:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666869248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449799:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666869248:12345-0@lo:400:kworker.0 Request processed in 28us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449805:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136153.449816:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136153.449821:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666869760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449847:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666869760:12345-0@lo:400:kworker.0 Request processed in 26us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449878:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136153.449905:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869120 00000100:00100000:1.0:1789136153.449908:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869120 00000100:00100000:1.0:1789136153.449926:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666869632 00000100:00100000:1.0:1789136153.449929:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666869632 00000100:00100000:1.0:1789136153.449939:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789136153.449945:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666869120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.449978:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666869120:12345-0@lo:400:kworker.0 Request processed in 33us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.449984:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789136153.450003:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136153.450008:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666869632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450037:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666869632:12345-0@lo:400:kworker.0 Request processed in 30us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.450042:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789136153.450072:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136153.450076:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136153.450079:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136153.450080:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136153.450115:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666869248:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450126:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666869760:0@lo:400:kworker.0 00010000:00080000:1.0:1789136153.450136:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7ff5d7c00 x1876044666870272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136153.450146:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666870272:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450155:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666869120:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450163:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666869632:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450170:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666870144:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450207:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666869376:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450216:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666869888:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450226:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666870400:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450235:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666868992:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450244:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666869504:0@lo:400:kworker.0 00000100:00100000:1.0:1789136153.450267:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666870016:0@lo:400:kworker.0 00010000:00080000:1.0:1789136153.450278:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f6608b40 x1876044666870528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136153.450285:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666870528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136153.454159:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666870656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136153.454251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136153.454356:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870656 00000100:00100000:1.0:1789136153.454363:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870656 00000100:00100000:1.0:1789136153.454414:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789136153.454438:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666870656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136153.454469:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136153.462272:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666870784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136153.462352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136153.462442:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870784 00000100:00100000:2.0:1789136153.462449:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870784 00000100:00100000:2.0:1789136153.462493:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789136153.462502:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666870784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136153.462526:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136153.462573:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666870784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136153.462580:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136153.463013:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666870656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8589us (8760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136153.463021:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789136153.463112:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666870784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136153.470456:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666870656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789136153.967392:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136154.474382:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136154.474408:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666870912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136154.474496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136154.474546:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666870912 00000100:00100000:0.0:1789136154.474553:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666870912 00000100:00100000:0.0:1789136154.474604:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789136154.474613:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666870912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136154.474647:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136154.474694:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666870912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136154.474713:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789136154.474760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666870912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789136154.984281:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136155.496531:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136155.496557:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666871040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136155.496632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136155.496698:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666871040 00000100:00100000:3.0:1789136155.496707:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666871040 00000100:00100000:3.0:1789136155.496766:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136155.496776:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666871040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136155.496801:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789136155.496876:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666871040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136155.496883:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789136155.496906:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136155.497132:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666871168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136155.497170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136155.497208:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666871168 00000100:00100000:1.0:1789136155.497212:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666871168 00000100:00100000:1.0:1789136155.497243:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136155.497260:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666871168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136155.497289:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136155.497329:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666871168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136155.497336:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136155.497380:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666871168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136155.498035:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666871040:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789136156.008326:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136156.008794:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136156.008819:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666871296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136156.009309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136156.014019:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666871296 00000100:00100000:1.0:1789136156.014033:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666871296 00000100:00100000:1.0:1789136156.014094:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136156.014104:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666871296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136156.014139:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136156.014219:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666871296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (5312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136156.014227:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136156.014294:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666871296:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1789136156.758810:0:20791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0a9b0050 20000000:00000080:2.0:1789136156.758829:0:20791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7fa3c6c00 uarg=0000000000000000 20000000:01000000:2.0:1789136156.759080:0:20791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789136156.759087:0:20791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789136156.759092:0:20791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789136156.759759:0:20792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:2.0:1789136156.760185:0:20791:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789136156.766694:0:20791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789136156.767525:0:20791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767545:0:20791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 23 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767553:0:20791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767560:0:20791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767567:0:20791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767590:0:20791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767599:0:20791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 12 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767606:0:20791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767665:0:20791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 12 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767682:0:20791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 12 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.767699:0:20791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871424:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136156.767929:0:20791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767939:0:20791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 12 pid: 17745 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.767949:0:20791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871552:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136156.767984:0:20791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.767993:0:20791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 23 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.768015:0:20791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871680:0@lo:104: 00000100:00100000:3.0:1789136156.768059:0:20791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136156.768143:0:20791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.768153:0:20791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 23 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.768162:0:20791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871808:0@lo:104: 00000100:00100000:3.0:1789136156.768201:0:20791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136156.768616:0:20791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.768625:0:20791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 23 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.768634:0:20791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871936:0@lo:104: 00000100:00100000:3.0:1789136156.768671:0:20791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136156.768732:0:17736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666871680 00000100:00100000:0.0:1789136156.768739:0:17736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666871680 00010000:00010000:3.0:1789136156.768904:0:20791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 23 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.768913:0:20791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 23 pid: 17746 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.768922:0:20791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666872064:0@lo:104: 00000100:00100000:3.0:1789136156.768946:0:20791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136156.768957:0:20791:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136156.769074:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666871808 00000100:00100000:1.0:1789136156.769079:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666871808 00000100:00100000:1.0:1789136156.769121:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666871936 00000100:00100000:1.0:1789136156.769123:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666871936 00000100:00100000:1.0:1789136156.769134:0:17737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872064 00000100:00100000:1.0:1789136156.769136:0:17737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872064 00000100:00100000:1.0:1789136156.769149:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136156.769158:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+6:20791:x1876044666871808:12345-0@lo:104: 00010000:00010000:1.0:1789136156.769173:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136156.769293:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136156.769300:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+6:20791:x1876044666871808:12345-0@lo:104: Request processed in 143us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136156.769307:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136156.769330:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136156.769336:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+5:20791:x1876044666871936:12345-0@lo:104: 00010000:00010000:1.0:1789136156.769344:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136156.769399:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136156.769404:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+5:20791:x1876044666871936:12345-0@lo:104: Request processed in 69us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136156.769410:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136156.769423:0:17737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136156.769440:0:17737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:20791:x1876044666872064:12345-0@lo:104: 00010000:00010000:1.0:1789136156.769449:0:17737:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136156.769474:0:17737:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789136156.769479:0:17737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:511c13c6-847f-45db-8965-d0deb75673dc+4:20791:x1876044666872064:12345-0@lo:104: Request processed in 41us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136156.769485:0:17737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136156.769520:0:17736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136156.769528:0:17736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+3:20791:x1876044666871680:12345-0@lo:104: 00010000:00010000:1.0:1789136156.769537:0:17736:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136156.769566:0:17736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789136156.769571:0:17736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:511c13c6-847f-45db-8965-d0deb75673dc+3:20791:x1876044666871680:12345-0@lo:104: Request processed in 45us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136156.769577:0:17736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789136156.769706:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789136156.769714:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769721:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5a00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136156.769725:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769734:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136156.769750:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136156.769755:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789136156.769802:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769810:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136156.769832:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769839:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5a00/0x559c8745c6de3dc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3dcd expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769851:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136156.769876:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769882:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136156.769885:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769892:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136156.769898:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136156.769903:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789136156.769925:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769932:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136156.769939:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769945:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f000/0x559c8745c6de3d87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d8e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769956:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136156.769959:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769966:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3ea00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136156.769968:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769974:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136156.769979:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136156.769984:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789136156.769993:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.769998:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136156.770008:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770023:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3ea00/0x559c8745c6de3d79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3d80 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770034:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136156.770037:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770042:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3e800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136156.770045:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770052:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136156.770059:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136156.770064:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789136156.770078:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770083:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136156.770088:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770095:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3e800/0x559c8745c6de3f32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de3f39 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770107:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136156.770113:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136156.770115:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136156.770129:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666872192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136156.770164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136156.770202:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136156.770208:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666872320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136156.770230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136156.770257:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872192 00000100:00100000:2.0:1789136156.770262:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872192 00010000:00010000:2.0:1789136156.770284:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 24 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136156.770307:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872320 00000100:00100000:2.0:1789136156.770310:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872320 00010000:00010000:2.0:1789136156.770320:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 25 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136156.770333:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136156.770339:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+25:3640:x1876044666872192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136156.770350:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136156.770355:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 25 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770365:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 25 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770383:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136156.770409:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+25:3640:x1876044666872192:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136156.770416:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136156.770452:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136156.770459:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+24:3640:x1876044666872320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136156.770467:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136156.770473:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 24 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770481:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 24 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.770491:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136156.770513:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:511c13c6-847f-45db-8965-d0deb75673dc+24:3640:x1876044666872320:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136156.770519:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136156.770556:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666872320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136156.770564:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666872192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136156.770730:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136156.771032:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666872448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136156.771069:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136156.771105:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136156.771111:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666872576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136156.771145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136156.771211:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872448 00000100:00100000:0.0:1789136156.771216:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872448 00010000:00010000:0.0:1789136156.771237:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 24 pid: 17746 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136156.771266:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872576 00000100:00100000:0.0:1789136156.771269:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872576 00010000:00010000:0.0:1789136156.771280:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 25 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136156.771302:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136156.771309:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+25:3638:x1876044666872448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136156.771319:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136156.771325:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 25 pid: 17746 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136156.771333:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 25 pid: 17746 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136156.771346:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136156.771387:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+25:3638:x1876044666872448:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136156.771394:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136156.771408:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136156.771415:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666872576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136156.771422:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136156.771438:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 24 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136156.771446:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 24 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136156.771456:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136156.771479:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666872576:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136156.771485:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136156.771511:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666872576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136156.771528:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666872448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136156.772269:0:20791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de3dcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3dc6 expref: 23 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.772296:0:20791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871808:0@lo:104: 00010000:00010000:3.0:1789136156.772315:0:20791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879e00/0x559c8745c6de3d8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3d87 expref: 22 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.772324:0:20791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871936:0@lo:104: 00010000:00010000:3.0:1789136156.772335:0:20791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879000/0x559c8745c6de3d80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3d79 expref: 21 pid: 17746 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.772343:0:20791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666872064:0@lo:104: 00010000:00010000:3.0:1789136156.772353:0:20791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5800/0x559c8745c6de3f39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de3f32 expref: 20 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136156.772360:0:20791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871680:0@lo:104: 00000100:00100000:3.0:1789136156.773090:0:20791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871424:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136156.773101:0:20791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20791:1876044666871552:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136156.773132:0:20791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136156.774120:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136156.774163:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747520 00000100:00100000:2.0:1789136156.774171:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747520 00010000:00010000:2.0:1789136156.774204:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 13 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136156.774209:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136156.774242:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747648 00000100:00100000:2.0:1789136156.774245:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747648 00010000:00010000:2.0:1789136156.774260:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 14 pid: 17745 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136156.774276:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789136156.774285:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7d35a68-30a0-4475-a8ab-9673ac334408+14:2391:x1876044644747520:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136156.774300:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136156.774319:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 14 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774331:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 14 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774355:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167d800/0x559c8745c6de40c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dc1 expref: 14 pid: 17747 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774370:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136156.774446:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2391:x1876044644747520:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 162us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136156.774454:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789136156.774499:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136156.774506:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7d35a68-30a0-4475-a8ab-9673ac334408+12:2391:x1876044644747648:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136156.774513:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136156.774518:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 12 pid: 17745 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774528:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 12 pid: 17745 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774538:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d51 expref: 12 pid: 17745 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774975:0:17739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.774986:0:17739:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775011:0:17739:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775018:0:17739:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775025:0:17739:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775032:0:17739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775038:0:17739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136156.775041:0:17739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775049:0:17739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775064:0:17739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136156.775075:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136156.775112:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7d35a68-30a0-4475-a8ab-9673ac334408+11:2391:x1876044644747648:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 605us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136156.775119:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00010000:00010000:3.0:1789136156.777388:0:20791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.777406:0:20791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136156.777412:0:20791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de40f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136156.778074:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136157.035265:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136157.687223:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687312:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687333:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687349:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687381:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687398:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136157.687420:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136157.687521:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747776 00000100:00100000:0.0:1789136157.687531:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747776 00000100:00100000:0.0:1789136157.687598:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:0.0:1789136157.687608:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:2390:x1876044644747776:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136157.687878:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:2390:x1876044644747776:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 245us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136157.687888:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:1.0:1789136157.688736:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748032 00000100:00100000:1.0:1789136157.688744:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748032 00000100:00100000:1.0:1789136157.688798:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748544 00000100:00100000:1.0:1789136157.688802:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748544 00000100:00080000:2.0:1789136157.688804:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136157.688816:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644747904 00000100:00100000:1.0:1789136157.688819:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644747904 00000100:00100000:1.0:1789136157.688846:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748416 00000100:00100000:1.0:1789136157.688849:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748416 00000100:00080000:2.0:1789136157.688878:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136157.688915:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1789136157.688924:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644748032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136157.688983:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644748032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 60us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136157.688990:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1789136157.689007:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1789136157.689013:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644748544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136157.689037:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644748544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136157.689044:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1789136157.689054:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:0.0:1789136157.690007:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:0.0:1789136157.694905:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2390:x1876044644748416:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136157.695008:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2390:x1876044644748416:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 4991us (7608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136157.695019:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:0.0:1789136157.695067:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748288 00000100:00100000:0.0:1789136157.695074:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748288 00000100:00100000:0.0:1789136157.695129:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748800 00000100:00100000:0.0:1789136157.695133:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748800 00000100:00100000:0.0:1789136157.695148:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748160 00000100:00100000:0.0:1789136157.695151:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748160 00000100:00100000:0.0:1789136157.695174:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748672 00000100:00100000:0.0:1789136157.695177:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748672 00000100:00100000:0.0:1789136157.695197:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789136157.695206:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644748288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136157.695238:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644748288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (7926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136157.695245:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00080000:2.0:1789136157.697185:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136157.697198:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136157.697626:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2390:x1876044644747904:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136157.697724:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2390:x1876044644747904:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 8662us (10357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136157.697733:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:2.0:1789136157.697880:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136157.697894:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644748800:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136157.697927:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644748800:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 40us (10577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136157.697934:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136157.697947:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1789136157.697953:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644748160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136157.697975:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644748160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (10593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136157.697980:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1789136157.697993:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1789136157.697999:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644748672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136157.698022:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644748672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (10601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136157.698038:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00010000:00010000:2.0:1789136158.057462:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789136158.379937:0:17750:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136158.379946:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7ff501000 from 19 10000000:01000000:2.0:1789136158.379966:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136158.380028:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.380041:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.380054:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136158.380081:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666872704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.380153:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.380203:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136158.386446:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872704 00000100:00100000:3.0:1789136158.386464:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872704 00000100:00100000:3.0:1789136158.386536:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789136158.386546:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+20:17750:x1876044666872704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136158.386563:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136158.386583:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de4100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de40f9 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.386614:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de4100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de40f9 expref: 21 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.386635:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de4100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de40f9 expref: 21 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.386646:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f400, rc 0) 00000100:00100000:3.0:1789136158.386735:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666872704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (6582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.386742:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789136158.388880:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666872704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136158.388911:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.388925:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136158.389015:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666872832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.389068:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.389108:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.389124:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872832 00000100:00100000:2.0:1789136158.389137:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872832 00000100:00100000:2.0:1789136158.389174:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789136158.389181:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666872832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.389330:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666872832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.389337:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789136158.389370:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666872832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.389394:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666872960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.389427:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.389441:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.389455:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666872960 00000100:00100000:2.0:1789136158.389458:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666872960 00000100:00100000:2.0:1789136158.389481:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789136158.389487:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666872960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.389568:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666872960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.389576:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789136158.389613:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666872960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136158.390267:0:20845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789136158.392834:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789136158.394539:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136158.394557:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.394571:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136158.394582:0:17750:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789136158.394584:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c44ff800 from 19 10000000:01000000:1.0:1789136158.394588:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136158.394625:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.394641:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.394651:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136158.394676:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136158.394747:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136158.394802:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.394832:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873088 00000100:00100000:2.0:1789136158.394840:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873088 00000100:00100000:2.0:1789136158.394907:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789136158.394917:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f5a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+21:17750:x1876044666873088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136158.394930:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136158.394945:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de410e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4107 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.394992:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de410e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4107 expref: 22 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.395002:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de410e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4107 expref: 22 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.395010:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5c00, rc 0) 00000100:00100000:2.0:1789136158.395053:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f5a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666873088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.395060:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789136158.398749:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136158.398781:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.398794:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136158.398918:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136158.398983:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136158.399035:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.400581:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873216 00000100:00100000:2.0:1789136158.400600:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873216 00000100:00100000:2.0:1789136158.400664:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789136158.400676:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666873216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.400876:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666873216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.400884:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789136158.401030:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136158.401080:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136158.401138:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136158.401169:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c22259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.402667:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873344 00000100:00100000:2.0:1789136158.402679:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873344 00000100:00100000:2.0:1789136158.402734:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789136158.404054:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666873344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.404231:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666873344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1487us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.404241:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789136158.404336:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136158.410697:0:20846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789136158.410788:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789136158.410830:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136158.410843:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.410877:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136158.410890:0:17750:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136158.410893:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c3dd6000 from 19 10000000:01000000:2.0:1789136158.410896:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136158.410932:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.410941:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.410953:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136158.410981:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.411060:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.411107:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.411128:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873472 00000100:00100000:2.0:1789136158.411135:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873472 00000100:00100000:2.0:1789136158.411181:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789136158.411191:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+22:17750:x1876044666873472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136158.411206:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136158.411220:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de411c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4115 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.411255:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de411c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4115 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.411266:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de411c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4115 expref: 23 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.411276:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5a00, rc 0) 00000100:00100000:2.0:1789136158.411319:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666873472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.411326:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789136158.411387:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136158.411402:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.411411:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136158.411460:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.411484:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.411498:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.411512:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873600 00000100:00100000:2.0:1789136158.411515:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873600 00000100:00100000:2.0:1789136158.411538:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789136158.411545:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666873600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.411664:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666873600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.411680:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789136158.411711:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.411740:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.411779:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.411791:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136158.411803:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873728 00000100:00100000:2.0:1789136158.411806:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873728 00000100:00100000:2.0:1789136158.411829:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789136158.411835:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666873728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.411932:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666873728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.411938:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789136158.411981:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136158.429267:0:20848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789136158.435624:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789136158.435679:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789136158.435693:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.435707:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136158.435801:0:17750:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136158.435804:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7d8b2f000 from 19 10000000:01000000:2.0:1789136158.435807:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136158.435851:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.436440:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.436454:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136158.436623:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.436714:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.436766:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136158.437167:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873856 00000100:00100000:3.0:1789136158.437174:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873856 00000100:00100000:3.0:1789136158.437232:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789136158.437240:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+23:17750:x1876044666873856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136158.437256:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136158.437271:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de412a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4123 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.437300:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de412a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4123 expref: 24 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.437603:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de412a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4123 expref: 24 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.437614:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f200, rc 0) 00000100:00100000:3.0:1789136158.437683:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666873856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 443us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.437691:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789136158.438182:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136158.438212:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136158.438222:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136158.438293:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.439211:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136158.439324:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136158.453129:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666873984 00000100:00100000:0.0:1789136158.453147:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666873984 00000100:00100000:1.0:1789136158.460820:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789136158.460837:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666873984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136158.461117:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666873984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (21907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136158.461126:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789136158.461176:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666873984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136158.461422:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666874112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136158.461613:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136158.461662:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136158.461680:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874112 00000100:00100000:1.0:1789136158.461686:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874112 00000100:00100000:1.0:1789136158.461714:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789136158.461722:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666874112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136158.461819:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:17750:x1876044666874112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136158.461826:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789136158.461913:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:511c13c6-847f-45db-8965-d0deb75673dc:17750:1876044666874112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.462403:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136158.462618:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644748928 00000100:00100000:1.0:1789136158.462640:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644748928 00000100:00100000:1.0:1789136158.462672:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:1.0:1789136158.462680:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+11:15163:x1876044644748928:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136158.462691:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136158.462709:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167c800/0x559c8745c6de4131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08df9 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.462735:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167c800/0x559c8745c6de4131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df9 expref: 12 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.462747:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167c800/0x559c8745c6de4131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df9 expref: 12 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.462758:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167c800, rc 0) 00000100:00100000:1.0:1789136158.462796:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15163:x1876044644748928:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 118us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136158.462803:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 161 00000040:00080000:2.0:1789136158.464398:0:20852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789136158.464743:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789136158.464771:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136158.464783:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136158.464793:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136158.466242:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136158.466486:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749056 00000100:00100000:3.0:1789136158.466496:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749056 00000100:00100000:3.0:1789136158.466557:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:3.0:1789136158.466568:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15163:x1876044644749056:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136158.466749:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15163:x1876044644749056:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 181us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.466759:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:1.0:1789136158.477424:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136158.477662:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749184 00000100:00100000:2.0:1789136158.477673:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749184 00000100:00100000:2.0:1789136158.481681:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:2.0:1789136158.481708:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15163:x1876044644749184:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.481893:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15163:x1876044644749184:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 197us (4583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.481902:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:3.0:1789136158.503721:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136158.503764:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749312 00000100:00100000:3.0:1789136158.503774:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749312 00000100:00100000:3.0:1789136158.503826:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:3.0:1789136158.503836:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+12:15163:x1876044644749312:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136158.503887:0:17747:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136158.503907:0:17747:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9f800/0x559c8745c6de4138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e00 expref: -99 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.503938:0:17747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9f800/0x559c8745c6de4138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e00 expref: 13 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.503950:0:17747:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9f800/0x559c8745c6de4138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e00 expref: 13 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136158.503959:0:17747:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f800, rc 0) 00000100:00100000:3.0:1789136158.504006:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15163:x1876044644749312:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 172us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.504014:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:3.0:1789136158.512185:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136158.512241:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749440 00000100:00100000:2.0:1789136158.512251:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749440 00000100:00100000:2.0:1789136158.512310:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:2.0:1789136158.512321:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15163:x1876044644749440:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136158.512477:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15163:x1876044644749440:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 157us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.512492:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:3.0:1789136158.525698:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136158.525734:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749568 00000100:00100000:3.0:1789136158.525746:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749568 00000100:00100000:3.0:1789136158.525796:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:3.0:1789136158.525806:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15163:x1876044644749568:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136158.525995:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:15163:x1876044644749568:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 189us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.526003:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:3.0:1789136158.570227:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666874368:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.570318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.570355:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666874880:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.570391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.570410:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666875392:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.570435:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.570461:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789136158.570468:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666874240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136158.570491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.570509:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666874752:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.570529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.570543:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666875264:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.570558:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.570571:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666875776:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.570598:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575200:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666874496:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575329:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666875008:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575365:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666875520:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575386:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575416:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789136158.575422:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666874624:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575461:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666875136:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575480:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575495:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666875648:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575530:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.575558:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874368 00000100:00100000:3.0:1789136158.575565:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874368 00000100:00100000:3.0:1789136158.575599:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874880 00000100:00100000:3.0:1789136158.575602:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874880 00000100:00100000:3.0:1789136158.575618:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789136158.575638:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666874368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575693:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666874368:12345-0@lo:400:kworker.0 Request processed in 56us (5375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.575700:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789136158.575717:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136158.575723:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666874880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.575751:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666874880:12345-0@lo:400:kworker.0 Request processed in 29us (5361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.575756:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136158.575776:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875392 00000100:00100000:3.0:1789136158.575779:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875392 00000100:00100000:3.0:1789136158.575808:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874752 00000100:00100000:3.0:1789136158.575812:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874752 00000100:00100000:3.0:1789136158.575822:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875264 00000100:00100000:3.0:1789136158.575825:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875264 00000100:00100000:3.0:1789136158.575834:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875776 00000100:00100000:3.0:1789136158.575836:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875776 00000100:00100000:3.0:1789136158.575846:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875520 00000100:00100000:3.0:1789136158.575848:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875520 00000100:00100000:2.0:1789136158.576225:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874496 00000100:00100000:2.0:1789136158.576231:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874496 00000100:00100000:3.0:1789136158.576520:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875648 00000100:00100000:3.0:1789136158.576525:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875648 00000100:00100000:3.0:1789136158.576542:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789136158.576549:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666875392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.576599:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666875392:12345-0@lo:400:kworker.0 Request processed in 51us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.576606:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789136158.576620:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136158.576637:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666874752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.576666:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666874752:12345-0@lo:400:kworker.0 Request processed in 41us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.576671:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136158.576683:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789136158.576690:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666875264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.576718:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666875264:12345-0@lo:400:kworker.0 Request processed in 29us (6158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.576724:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789136158.576735:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789136158.576741:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666875776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136158.576762:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875008 00000100:00100000:2.0:1789136158.576768:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875008 00000100:00100000:3.0:1789136158.576772:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666875776:12345-0@lo:400:kworker.0 Request processed in 29us (6171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.576780:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789136158.576792:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874624 00000100:00100000:2.0:1789136158.576797:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874624 00000100:00100000:3.0:1789136158.576801:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136158.576810:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666875520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136158.576815:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875136 00000100:00100000:2.0:1789136158.576819:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875136 00000100:00100000:3.0:1789136158.576849:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666875520:12345-0@lo:400:kworker.0 Request processed in 41us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.577243:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789136158.577252:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666874496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.577497:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789136158.577513:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136158.577520:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666875648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.577572:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666875648:12345-0@lo:400:kworker.0 Request processed in 53us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.577578:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136158.577602:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666874240 00000100:00100000:3.0:1789136158.577607:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666874240 00000100:00100000:3.0:1789136158.577645:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136158.577651:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876044666874240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136158.577673:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136158.577706:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1876044666874240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (7213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.577712:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136158.577812:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136158.577821:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666875008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136158.578237:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666874496:12345-0@lo:400:kworker.0 Request processed in 986us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.578245:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789136158.578262:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789136158.578348:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666874624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136158.578386:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666874624:12345-0@lo:400:kworker.0 Request processed in 119us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.578392:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789136158.578404:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136158.578411:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666875136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136158.578437:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666875136:12345-0@lo:400:kworker.0 Request processed in 27us (2955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.578442:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136158.578461:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136158.578478:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666875904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136158.578522:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666875008:12345-0@lo:400:kworker.0 Request processed in 34us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136158.578531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136158.578536:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136158.578568:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666875904 00000100:00100000:3.0:1789136158.578573:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666875904 00000100:00100000:3.0:1789136158.578603:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136158.578611:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666875904:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789136158.578612:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136158.578620:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136158.578634:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136158.578637:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:3.0:1789136158.578638:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136158.578682:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666875904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136158.578688:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136158.578739:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666874240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136158.578755:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666874752:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.578777:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666875264:0@lo:400:kworker.0 00010000:00080000:3.0:1789136158.578792:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c109ad00 x1876044666875776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136158.578805:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666875776:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.578818:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666874368:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.578832:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666874880:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.578844:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666875392:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.579047:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666874624:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.579056:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666875136:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.579066:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666875648:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.579076:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666874496:0@lo:400:kworker.0 00000100:00100000:3.0:1789136158.579086:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666875008:0@lo:400:kworker.0 00010000:00080000:3.0:1789136158.579096:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c1098b40 x1876044666875520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136158.579105:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666875520:0@lo:400:kworker.0 00000100:00100000:2.0:1789136158.580371:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666875904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789136159.082485:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136159.594172:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136159.594197:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666876032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136159.594269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136159.594321:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666876032 00000100:00100000:0.0:1789136159.594330:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666876032 00000100:00100000:0.0:1789136159.594384:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789136159.594394:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666876032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136159.594427:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789136159.594474:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666876032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136159.594480:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789136159.594529:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666876032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789136160.106025:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136160.360790:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789136160.616239:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136160.616268:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666876160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136160.616352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136160.616473:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666876160 00000100:00100000:1.0:1789136160.616483:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666876160 00000100:00100000:1.0:1789136160.616549:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789136160.616575:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666876160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136160.616645:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789136160.616704:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666876160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136160.616711:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789136160.616770:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666876160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136160.618040:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136160.618059:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666876288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136160.618120:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136160.618205:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666876288 00000100:00100000:1.0:1789136160.618211:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666876288 00000100:00100000:1.0:1789136160.618263:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136160.618271:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666876288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789136160.618289:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789136160.618330:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666876288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136160.618336:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136160.618374:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666876288:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789136160.618532:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789136161.128294:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136161.129259:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136161.129283:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c96d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666876416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136161.129357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136161.129609:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666876416 00000100:00100000:3.0:1789136161.129618:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666876416 00000100:00100000:3.0:1789136161.129673:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789136161.129683:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666876416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136161.129717:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136161.129773:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666876416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.129781:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789136161.129945:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c96d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666876416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136161.190568:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.190800:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749696 00000100:00100000:3.0:1789136161.190810:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749696 00000100:00100000:3.0:1789136161.191011:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789136161.191023:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:15836:x1876044644749696:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136161.191044:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.191068:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de413f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e07 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191163:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191179:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191192:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191207:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191232:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191240:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191327:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e000/0x559c8745c6de4154 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191336:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e000/0x559c8745c6de4154 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191344:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e000/0x559c8745c6de4154 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136161.191374:0:17754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789136161.191378:0:17754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136161.191432:0:17754:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e000/0x559c8745c6de4154 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191443:0:17754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191450:0:17754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191458:0:17754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191465:0:17754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.191469:0:17754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191483:0:17754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191829:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:3.0:1789136161.191833:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.191840:0:17754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.191846:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de4146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192012:0:17754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192019:0:17754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192025:0:17754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192030:0:17754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.192033:0:17754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192039:0:17754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192047:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a7c3817d00) 00010000:00010000:3.0:1789136161.192050:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.192053:0:17754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192072:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de414d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192115:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de413f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e07 expref: 8 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192134:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e000/0x559c8745c6de4154 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e07 expref: 7 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.192141:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7c3817100) 00010000:00010000:3.0:1789136161.192143:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136161.192146:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e000, rc 0) 00000100:00100000:3.0:1789136161.192221:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15836:x1876044644749696:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1201us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.192229:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00080000:2.0:1789136161.192309:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136161.197431:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.197703:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644749824 00000100:00100000:1.0:1789136161.197714:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644749824 00000100:00100000:1.0:1789136161.197775:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1789136161.197785:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15836:x1876044644749824:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789136161.197897:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15836:x1876044644749824:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 Request processed in 113us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136161.197915:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:0.0:1789136161.204151:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.204263:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750080 00000100:00100000:1.0:1789136161.204273:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750080 00000100:00100000:1.0:1789136161.204333:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:1.0:1789136161.204343:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15836:x1876044644750080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136161.204371:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136161.204691:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de415b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e0e expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.204768:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.204783:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.204794:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.204837:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.204844:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.204850:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.205195:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d800/0x559c8745c6de4170 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.205204:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d800/0x559c8745c6de4170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.205212:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d800/0x559c8745c6de4170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136161.205221:0:18920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789136161.206036:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206047:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206054:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206061:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167de00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136161.206065:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206153:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206170:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7c3817100) 00010000:00010000:1.0:1789136161.206173:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136161.206179:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206186:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167de00/0x559c8745c6de4162 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206201:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206206:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206213:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206231:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136161.206234:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206240:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206249:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a7e0aa7a00) 00010000:00010000:1.0:1789136161.206251:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136161.206254:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.206259:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de4169 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.208251:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de415b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e0e expref: 10 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.208276:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d800/0x559c8745c6de4170 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e0e expref: 9 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.208286:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:1.0:1789136161.208288:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136161.208292:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d800, rc 0) 00000100:00100000:1.0:1789136161.208370:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15836:x1876044644750080:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 4027us (4227us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789136161.208379:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:0.0:1789136161.230663:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.230801:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750208 00000100:00100000:3.0:1789136161.230815:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750208 00000100:00100000:3.0:1789136161.230917:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:3.0:1789136161.230929:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15836:x1876044644750208:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789136161.231040:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15836:x1876044644750208:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 113us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.231049:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:0.0:1789136161.251959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136161.252136:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750336 00000100:00100000:2.0:1789136161.252147:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750336 00000100:00100000:2.0:1789136161.252222:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:2.0:1789136161.252234:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:15836:x1876044644750336:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789136161.256071:0:17755:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3795us 00000100:00080000:0.0:1789136161.256765:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136161.278428:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.280663:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750464 00000100:00100000:3.0:1789136161.280693:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750464 00000100:00100000:3.0:1789136161.280794:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:3.0:1789136161.280804:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15842:x1876044644750464:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789136161.280833:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.280878:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de417e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e15 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.280956:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.280971:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.280983:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.280996:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281004:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281010:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281048:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281054:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281059:0:17753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281071:0:17753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.281075:0:17753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281082:0:17753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281093:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:3.0:1789136161.281096:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.281100:0:17753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281106:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281119:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281125:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281130:0:17753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281134:0:17753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.281137:0:17753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281142:0:17753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281157:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7c3817d00) 00010000:00010000:3.0:1789136161.281158:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.281161:0:17753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281166:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de418c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281195:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de417e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e15 expref: 10 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281203:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:3.0:1789136161.281205:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.281208:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de417e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e15 expref: 10 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.281217:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e800, rc 0) 00000100:00100000:3.0:1789136161.281282:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15842:x1876044644750464:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 479us (2862us total) trans 0 rc 301/301 00000100:00100000:3.0:1789136161.281289:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:2.0:1789136161.284151:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9679680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:15836:x1876044644750336:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 31911us (32192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136161.284164:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:0.0:1789136161.291939:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136161.292093:0:17762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750592 00000100:00100000:2.0:1789136161.292103:0:17762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750592 00000100:00100000:2.0:1789136161.292146:0:17762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:2.0:1789136161.292153:0:17762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15842:x1876044644750592:12345-192.168.201.31@tcp:700:lfs.0 00000100:00100000:2.0:1789136161.292223:0:17762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15842:x1876044644750592:12345-192.168.201.31@tcp:700:lfs.0 Request processed in 70us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136161.292231:0:17762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1789136161.302050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.302107:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750848 00000100:00100000:3.0:1789136161.302116:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750848 00000100:00100000:3.0:1789136161.302220:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1789136161.302232:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:15842:x1876044644750848:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:3.0:1789136161.302307:0:18920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136161.302336:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de40ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d82 expref: 9 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.302377:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:3.0:1789136161.302381:0:18920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136161.302443:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.302457:0:18920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 5 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.302466:0:18920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.302499:0:18920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 5 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.302513:0:18920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 5 pid: 17754 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.302526:0:18920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18920:1876044666876544:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136161.302651:0:18920:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136161.311702:0:18920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18920:1876044666876544:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136161.311731:0:18920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136161.314827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.315043:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644750976 00000100:00100000:3.0:1789136161.315053:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644750976 00010000:00010000:3.0:1789136161.315110:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 6 pid: 17754 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.315179:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789136161.315189:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2392:x1876044644750976:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136161.315205:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136161.315212:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 6 pid: 17754 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.315224:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 6 pid: 17754 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.315248:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de40eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df2 expref: 6 pid: 17754 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.315266:0:17738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:3.0:1789136161.315271:0:17738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.315280:0:17738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.315287:0:17738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.315320:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789136161.315366:0:18920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.315375:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2392:x1876044644750976:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 187us (564us total) trans 0 rc 0/0 00010000:00010000:1.0:1789136161.315375:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.315383:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00010000:00010000:1.0:1789136161.315400:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.315410:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.315418:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789136161.315514:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789136161.318158:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318179:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318191:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789136161.318208:0:18920:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a27f5227 reply state 00000000692fbb46 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318219:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318227:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:1.0:1789136161.318230:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136161.318240:0:18920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789136161.318246:0:18920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789136161.318265:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318272:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318279:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.318285:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ec00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136161.318290:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.320058:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.320085:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3700) 00010000:00010000:1.0:1789136161.320088:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136161.320094:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.320101:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4193 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789136161.320126:0:18920:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a27f5227 reply state 00000000692fbb46 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.320138:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.320144:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7e0aa7a00) 00010000:00010000:1.0:1789136161.320159:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136161.320162:0:18920:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789136161.321831:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+10:15842:x1876044644750848:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 19591us (19780us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789136161.321843:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000040:00080000:2.0:1789136161.386406:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789136161.512198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.512494:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644751104 00000100:00100000:3.0:1789136161.512519:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644751104 00000100:00100000:3.0:1789136161.512597:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:3.0:1789136161.512607:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+10:15850:x1876044644751104:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:3.0:1789136161.512641:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.512666:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e1c expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.512733:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de41af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.512759:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de41af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.512774:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de41af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136161.512818:0:17753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789136161.512822:0:17753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136161.513141:0:17753:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de41af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.513169:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e1c expref: 12 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.513188:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de41af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e1c expref: 11 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.513197:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:3.0:1789136161.513200:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136161.513204:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9f600, rc 0) 00000100:00100000:3.0:1789136161.514510:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+11:15850:x1876044644751104:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 1895us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.514522:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789136161.549308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.549455:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644751232 00000100:00100000:1.0:1789136161.549466:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644751232 00000100:00100000:1.0:1789136161.549609:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:1.0:1789136161.549620:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:15851:x1876044644751232:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136161.549652:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136161.549675:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de41b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e23 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.549745:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de41bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.549761:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de41bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.549772:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de41bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136161.549813:0:17754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789136161.549817:0:17754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789136161.549837:0:17754:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de41bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.550103:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de41b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e23 expref: 7 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.550143:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de41bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e23 expref: 6 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136161.550152:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:1.0:1789136161.550155:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136161.550159:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ca00, rc 0) 00000100:00100000:1.0:1789136161.550221:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15851:x1876044644751232:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 603us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136161.550229:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:2.0:1789136161.560944:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.575285:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644751360 00000100:00100000:3.0:1789136161.575303:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644751360 00000100:00100000:3.0:1789136161.575389:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:3.0:1789136161.575400:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:15851:x1876044644751360:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789136161.575422:0:17755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.575446:0:17755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e2a expref: -99 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.575541:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.575557:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576368:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576418:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576438:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576447:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576619:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576805:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576813:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136161.576883:0:17755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789136161.576887:0:17755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136161.576913:0:17755:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576925:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576931:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576937:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576943:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.576947:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576955:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576967:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:3.0:1789136161.576970:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.576974:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.576990:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de41cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577003:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577010:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577016:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577021:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.577023:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577030:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577038:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7e0aa7a00) 00010000:00010000:3.0:1789136161.577041:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.577044:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577050:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577082:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e2a expref: 8 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577107:0:17755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e2a expref: 7 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.577115:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:3.0:1789136161.577117:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136161.577119:0:17755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fa00, rc 0) 00000100:00100000:3.0:1789136161.577197:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+7:15851:x1876044644751360:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1798us (16266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.577205:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1789136161.593163:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.594122:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644751488 00000100:00100000:1.0:1789136161.594137:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644751488 00000100:00100000:1.0:1789136161.594259:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1789136161.594270:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:15851:x1876044644751488:12345-192.168.201.31@tcp:900:lfs.0 00000100:00080000:0.0:1789136161.594728:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136161.594772:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:15851:x1876044644751488:12345-192.168.201.31@tcp:900:lfs.0 Request processed in 502us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136161.594781:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1789136161.601953:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.602665:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644751744 00000100:00100000:0.0:1789136161.602681:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644751744 00000100:00100000:0.0:1789136161.602763:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1789136161.602775:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+7:15851:x1876044644751744:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789136161.602810:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136161.602834:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de41e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e31 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136161.602995:0:17754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789136161.603101:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de41e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e31 expref: 9 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.603114:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:0.0:1789136161.603117:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136161.603122:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de41e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e31 expref: 9 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.603134:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:0.0:1789136161.603218:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+8:15851:x1876044644751744:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 434us (1272us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789136161.603241:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:2.0:1789136161.613230:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.613366:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644752000 00000100:00100000:3.0:1789136161.613605:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644752000 00000100:00100000:3.0:1789136161.613695:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:3.0:1789136161.616526:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c96d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+8:15851:x1876044644752000:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:3.0:1789136161.616649:0:17755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136161.616700:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e2a expref: 8 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.616729:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:3.0:1789136161.616736:0:17755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136161.616766:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.616782:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.616793:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136161.617114:0:17755:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000696e58d2 reply state 000000008a831a65 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.617130:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.617138:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:3.0:1789136161.617141:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789136161.617144:0:17755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789136161.617153:0:17755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789136161.617260:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c96d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+9:15851:x1876044644752000:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 3552us (4539us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789136161.617269:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:1.0:1789136161.629511:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.629700:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644752256 00000100:00100000:0.0:1789136161.629714:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644752256 00000100:00100000:0.0:1789136161.632052:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1789136161.632432:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+9:15851:x1876044644752256:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136161.633144:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+10:15851:x1876044644752256:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 1066us (3635us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789136161.633156:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:1.0:1789136161.639023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.639121:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644752512 00000100:00100000:3.0:1789136161.639133:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644752512 00000100:00100000:3.0:1789136161.639215:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:3.0:1789136161.639228:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+10:15851:x1876044644752512:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789136161.639262:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.639292:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e38 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639413:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639432:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639448:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639486:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639494:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639501:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136161.639649:0:18920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789136161.639752:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639761:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639767:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639773:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.639777:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639786:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639800:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:3.0:1789136161.639803:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.639807:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639826:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de41fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639842:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639847:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639935:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639940:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.639943:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639950:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639958:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7e0aa7a00) 00010000:00010000:3.0:1789136161.639961:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.639964:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.639971:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.640014:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e38 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.640036:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:3.0:1789136161.640038:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789136161.640043:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de41f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e38 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.640053:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fa00, rc 0) 00000100:00100000:3.0:1789136161.640149:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+11:15851:x1876044644752512:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 923us (1143us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789136161.640158:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:2.0:1789136161.645752:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.646338:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644752640 00000100:00100000:0.0:1789136161.646428:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644752640 00000100:00100000:0.0:1789136161.646525:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:0.0:1789136161.646538:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+11:15851:x1876044644752640:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789136161.646582:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136161.646613:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4211 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e3f expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.646745:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.646762:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.646779:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136161.646983:0:17753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789136161.646988:0:17753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136161.647316:0:17753:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.647624:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4211 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 13 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.647649:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 12 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.647659:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:0.0:1789136161.647661:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136161.647666:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:0.0:1789136161.648125:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:15851:x1876044644752640:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1587us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136161.648135:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1789136161.653156:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.653311:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644752768 00000100:00100000:1.0:1789136161.653325:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644752768 00000100:00100000:1.0:1789136161.653490:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1789136161.653503:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:15851:x1876044644752768:12345-192.168.201.31@tcp:37:lfs.0 00000100:00100000:0.0:1789136161.658850:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:15851:x1876044644752768:12345-192.168.201.31@tcp:37:lfs.0 Request processed in 5330us (5689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136161.658903:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1789136161.663665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.663768:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644753024 00000100:00100000:0.0:1789136161.663781:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644753024 00000100:00100000:0.0:1789136161.664692:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:0.0:1789136161.664711:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cc9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:15851:x1876044644753024:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136161.665114:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cc9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+13:15851:x1876044644753024:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 409us (1465us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789136161.665124:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1789136161.732355:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.732468:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644753152 00000100:00100000:3.0:1789136161.732482:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644753152 00000100:00100000:3.0:1789136161.732628:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:3.0:1789136161.732641:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+11:15857:x1876044644753152:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136161.732670:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.732700:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de421f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e46 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.732790:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.732807:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.732822:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.732834:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.733526:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.733537:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733765:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de4234 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733774:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de4234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733781:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de4234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136161.733830:0:18920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136161.733835:0:18920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136161.733908:0:18920:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de4234 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733922:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733927:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733933:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733937:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136161.733940:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733946:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733968:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:2.0:1789136161.733970:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136161.733974:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733979:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4226 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733993:0:18920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.733998:0:18920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734003:0:18920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734010:0:18920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136161.734012:0:18920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734019:0:18920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734025:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7e0aa7a00) 00010000:00010000:2.0:1789136161.734027:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136161.734030:0:18920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734035:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de422d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734082:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de421f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e46 expref: 13 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734099:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de4234 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e46 expref: 12 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136161.734107:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:2.0:1789136161.734109:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789136161.734112:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879a00, rc 0) 00000100:00100000:2.0:1789136161.734209:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+12:15857:x1876044644753152:12345-192.168.201.31@tcp:101:bash.0 Request processed in 1570us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136161.734218:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:1.0:1789136161.739281:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.739618:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644753280 00000100:00100000:3.0:1789136161.739633:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644753280 00000100:00100000:3.0:1789136161.739752:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789136161.739765:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:15857:x1876044644753280:12345-192.168.201.31@tcp:900:bash.0 00000100:00100000:3.0:1789136161.739916:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:15857:x1876044644753280:12345-192.168.201.31@tcp:900:bash.0 Request processed in 153us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.739925:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1789136161.743423:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136161.743561:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644753536 00000100:00100000:3.0:1789136161.743584:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644753536 00000100:00100000:3.0:1789136161.743668:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:3.0:1789136161.743680:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+12:15857:x1876044644753536:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136161.743711:0:17755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136161.743739:0:17755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de423b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e4d expref: -99 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.743934:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.743957:0:17755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 12 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.744138:0:17755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.744187:0:17755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 12 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.744203:0:17755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 12 pid: 17753 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.744220:0:17755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17755:1876044666876672:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136161.744343:0:17755:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa56f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136161.747585:0:17755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17755:1876044666876672:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136161.747633:0:17755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136161.749839:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.750226:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644753664 00000100:00100000:0.0:1789136161.750240:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644753664 00010000:00010000:0.0:1789136161.750301:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 13 pid: 17753 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136161.750371:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789136161.750382:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+13:2391:x1876044644753664:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136161.750405:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136161.750414:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 13 pid: 17753 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.750428:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 13 pid: 17753 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.750462:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4218 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e3f expref: 13 pid: 17753 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.750484:0:17740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:0.0:1789136161.750491:0:17740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.750503:0:17740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.750513:0:17740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.750553:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136161.750633:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:2391:x1876044644753664:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 251us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136161.750642:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00010000:00010000:3.0:1789136161.750726:0:17755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.750737:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.750774:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.750787:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.750796:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751663:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751698:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751713:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136161.751735:0:17755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789136161.751795:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751803:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751811:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751818:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ec00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.751825:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751833:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.751847:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:3.0:1789136161.751850:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136161.751980:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.752007:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9ec00/0x559c8745c6de4242 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136161.752023:0:17755:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000004840985 reply state 00000000c267725c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.752047:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.752053:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90a7c3817a00) 00010000:00010000:3.0:1789136161.752055:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789136161.752059:0:17755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789136161.752112:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de423b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 15 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.752137:0:17755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 14 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.752145:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136161.752147:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789136161.752149:0:17755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e600, rc 0) 00000100:00100000:3.0:1789136161.752246:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b01a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+15:15857:x1876044644753536:12345-192.168.201.31@tcp:101:bash.0 Request processed in 8568us (8838us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789136161.752256:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:2.0:1789136161.766058:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.766185:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644753792 00000100:00100000:0.0:1789136161.766219:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644753792 00000100:00100000:0.0:1789136161.766300:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:0.0:1789136161.766312:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+15:15857:x1876044644753792:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1789136161.766356:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136161.766387:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de425e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e54 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766490:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766508:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766522:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136161.766605:0:17754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789136161.766610:0:17754:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136161.766639:0:17754:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766652:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766683:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de425e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 17 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766705:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 16 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.766715:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136161.766725:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136161.766731:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:0.0:1789136161.766817:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:15857:x1876044644753792:12345-192.168.201.31@tcp:101:bash.0 Request processed in 507us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136161.766825:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:2.0:1789136161.775162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.775969:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644754048 00000100:00100000:1.0:1789136161.776007:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644754048 00000100:00100000:1.0:1789136161.776076:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1789136161.776088:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:15857:x1876044644754048:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:1.0:1789136161.776463:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+17:15857:x1876044644754048:12345-192.168.201.31@tcp:35:bash.0 Request processed in 375us (1318us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789136161.776473:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1789136161.874951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.875222:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644754304 00000100:00100000:0.0:1789136161.875235:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644754304 00000100:00100000:0.0:1789136161.875322:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1789136161.875342:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+17:15867:x1876044644754304:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789136161.875375:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136161.875403:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de426c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e5b expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136161.875547:0:17753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789136161.875691:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de426c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e5b expref: 19 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.875711:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:0.0:1789136161.875715:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136161.875722:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de426c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e5b expref: 19 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.875740:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:0.0:1789136161.876364:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+18:15867:x1876044644754304:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1028us (1425us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789136161.876374:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1789136161.879130:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.879376:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644754560 00000100:00100000:0.0:1789136161.879410:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644754560 00000100:00100000:0.0:1789136161.879496:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1789136161.879508:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+18:15867:x1876044644754560:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136161.879920:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+19:15867:x1876044644754560:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 412us (803us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789136161.879930:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000040:00080000:3.0:1789136161.897749:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789136161.986297:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.986420:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644754816 00000100:00100000:0.0:1789136161.986437:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644754816 00000100:00100000:0.0:1789136161.986660:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:0.0:1789136161.986673:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+19:15870:x1876044644754816:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1789136161.986698:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136161.986721:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de427a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e62 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.986909:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de4281 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.986924:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de4281 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.986939:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de4281 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136161.986951:0:17754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789136161.987075:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de427a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e62 expref: 22 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.987095:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de4281 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e62 expref: 21 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136161.987124:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136161.987127:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136161.987131:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae600, rc 0) 00000100:00100000:0.0:1789136161.987222:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+21:15870:x1876044644754816:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 551us (938us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789136161.987231:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:1.0:1789136161.993916:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136161.993967:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136161.994100:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644755072 00000100:00100000:0.0:1789136161.994116:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644755072 00000100:00100000:3.0:1789136161.994186:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644754944 00000100:00100000:3.0:1789136161.994198:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644754944 00000100:00100000:0.0:1789136161.994226:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1789136161.994245:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+22:2390:x1876044644755072:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136161.994266:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789136161.994274:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00010000:00010000:0.0:1789136161.994305:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de4281 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e62 expref: 22 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.994316:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+22:15870:x1876044644754944:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:0.0:1789136161.994359:0:17738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136161.994366:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136161.994434:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136161.994446:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+21:2390:x1876044644755072:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 203us (473us total) trans 0 rc 0/0 00010000:00010000:3.0:1789136161.994461:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136161.994463:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00010000:00010000:3.0:1789136161.994485:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994533:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994541:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994549:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994556:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fe00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136161.994571:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994581:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994593:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136161.994596:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789136161.994601:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136161.994608:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de428f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136161.994685:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+20:15870:x1876044644754944:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 377us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136161.994697:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:3.0:1789136161.997624:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136162.002147:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644755328 00000100:00100000:0.0:1789136162.002172:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644755328 00000100:00100000:0.0:1789136162.002326:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1789136162.002351:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+20:15870:x1876044644755328:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136162.002766:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+21:15870:x1876044644755328:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 428us (5156us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789136162.002786:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00010000:00010000:2.0:1789136162.157650:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136162.349605:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.349790:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644755584 00000100:00100000:2.0:1789136162.349809:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644755584 00000100:00100000:2.0:1789136162.349965:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:2.0:1789136162.349979:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+21:15901:x1876044644755584:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1789136162.350016:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136162.350047:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4296 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e69 expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.350387:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de429d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.350405:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de429d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.350417:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de429d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136162.350431:0:18920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789136162.350595:0:18920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4296 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e69 expref: 24 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.350635:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de429d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e69 expref: 23 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.350644:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136162.350647:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136162.350651:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879e00, rc 0) 00000100:00100000:2.0:1789136162.350724:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:15901:x1876044644755584:12345-192.168.201.31@tcp:101:cat.0 Request processed in 747us (1128us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789136162.350733:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:2.0:1789136162.357418:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.357470:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136162.357642:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644755840 00000100:00100000:1.0:1789136162.357655:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644755840 00000100:00100000:1.0:1789136162.357732:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1789136162.357742:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:15901:x1876044644755840:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:1.0:1789136162.358480:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+24:15901:x1876044644755840:12345-192.168.201.31@tcp:35:cat.0 Request processed in 737us (1072us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789136162.358489:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1789136162.358821:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644755968 00000100:00100000:0.0:1789136162.358835:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644755968 00000100:00100000:0.0:1789136162.358933:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1789136162.358945:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+24:2389:x1876044644755968:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136162.358965:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136162.359010:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879e00/0x559c8745c6de429d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e69 expref: 24 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.359046:0:17739:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136162.359053:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136162.359108:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:2389:x1876044644755968:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 166us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.359115:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:3.0:1789136162.446504:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.446698:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644756224 00000100:00100000:2.0:1789136162.446715:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644756224 00000100:00100000:2.0:1789136162.446790:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:2.0:1789136162.446802:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:15907:x1876044644756224:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:2.0:1789136162.446894:0:17755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136162.446928:0:17755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de42ab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e70 expref: -99 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.447080:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.447097:0:17755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.447105:0:17755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 24 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.447114:0:17755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.447154:0:17755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 24 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.447167:0:17755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 24 pid: 17754 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136162.447180:0:17755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17755:1876044666876800:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136162.447307:0:17755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136162.448831:0:17755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136162.449052:0:17755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17755:1876044666876928:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136162.449988:0:17755:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789136162.456157:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.456291:0:17755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ae580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17755:1876044666876800:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136162.456312:0:17755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17755:1876044666876928:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136162.456353:0:17755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136162.456463:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644756352 00000100:00100000:0.0:1789136162.456474:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644756352 00010000:00010000:0.0:1789136162.456527:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 25 pid: 17754 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136162.456588:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1789136162.456599:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+25:2391:x1876044644756352:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136162.456618:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136162.456626:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 25 pid: 17754 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.456641:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 25 pid: 17754 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.456688:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de4265 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e54 expref: 25 pid: 17754 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.456708:0:17740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136162.456714:0:17740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.456724:0:17740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.456732:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136162.456803:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+24:2391:x1876044644756352:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 205us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.456812:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1789136162.457101:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136162.457446:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644756480 00000100:00100000:1.0:1789136162.457452:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644756480 00010000:00010000:1.0:1789136162.457485:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136162.457513:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:1.0:1789136162.457521:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f688d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+24:2391:x1876044644756480:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136162.457531:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136162.457545:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457567:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457585:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e600/0x559c8745c6de4250 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e4d expref: 24 pid: 17755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457601:0:17738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136162.457606:0:17738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457616:0:17738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457623:0:17738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457652:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136162.457688:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f688d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:2391:x1876044644756480:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 168us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136162.457695:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00010000:00010000:1.0:1789136162.457803:0:17755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.457813:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136162.457837:0:17755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789136162.458431:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de42ab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e70 expref: 24 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.458467:0:17755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e70 expref: 23 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.458476:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136162.458478:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789136162.458482:0:17755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878600, rc 0) 00000100:00100000:1.0:1789136162.458534:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:15907:x1876044644756224:12345-192.168.201.31@tcp:101:dd.0 Request processed in 11734us (12043us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789136162.458543:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1789136162.464148:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136162.465364:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644756608 00000100:00100000:0.0:1789136162.465383:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644756608 00000100:00100000:0.0:1789136162.465490:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:0.0:1789136162.465502:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+23:15907:x1876044644756608:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:0.0:1789136162.465535:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136162.465572:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e77 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.465622:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.465639:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.465677:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.465833:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 25 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.465880:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 24 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.466447:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136162.466450:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136162.466454:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:0.0:1789136162.466569:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+24:15907:x1876044644756608:12345-192.168.201.31@tcp:101:dd.0 Request processed in 1067us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.466579:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1789136162.489439:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136162.493126:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644756864 00000100:00100000:1.0:1789136162.493142:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644756864 00000100:00100000:1.0:1789136162.493217:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:1.0:1789136162.493226:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+24:15907:x1876044644756864:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:1.0:1789136162.493461:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.493478:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.493489:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136162.493528:0:17753:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789136162.493546:0:17753:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fea3d27b reply state 00000000897dec79 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.493591:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.493615:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136162.493617:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136162.493621:0:17753:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789136162.493745:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+27:15907:x1876044644756864:12345-192.168.201.31@tcp:36:dd.0 Request processed in 519us (4315us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789136162.493753:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000020:00080000:1.0:1789136162.493759:0:17753:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789136162.497963:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136162.498247:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644756992 00000100:00100000:1.0:1789136162.498259:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644756992 00000100:00100000:1.0:1789136162.498383:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:1.0:1789136162.498395:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+27:15907:x1876044644756992:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:1.0:1789136162.498419:0:18920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136162.498440:0:18920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e7e expref: -99 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.498506:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e7e expref: 28 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.498521:0:18920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e7e expref: 28 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.498539:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136162.498542:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789136162.498546:0:18920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167da00, rc 0) 00000100:00100000:1.0:1789136162.498622:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15907:x1876044644756992:12345-192.168.201.31@tcp:101:dd.0 Request processed in 230us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136162.498630:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:3.0:1789136162.553976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136162.555127:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644757248 00000100:00100000:1.0:1789136162.555140:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644757248 00000100:00100000:1.0:1789136162.555223:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:1.0:1789136162.555234:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15907:x1876044644757248:12345-192.168.201.31@tcp:103:dd.0 00010000:00010000:1.0:1789136162.555251:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136162.555280:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e7e expref: 28 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.555304:0:17738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136162.555310:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136162.555382:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+27:15907:x1876044644757248:12345-192.168.201.31@tcp:103:dd.0 Request processed in 149us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136162.555389:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:3.0:1789136162.564201:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136162.564365:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644757376 00000100:00100000:1.0:1789136162.564374:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644757376 00000100:00100000:1.0:1789136162.564439:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1789136162.564449:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+27:15907:x1876044644757376:12345-192.168.201.31@tcp:58:dd.0 00010000:00010000:1.0:1789136162.564571:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.564590:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136162.564603:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136162.572752:0:17753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136162.574965:0:17753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789136162.575205:0:17753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789136162.576089:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+27:15907:x1876044644757376:12345-192.168.201.31@tcp:58:dd.0 Request processed in 11633us (11890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136162.576102:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:2.0:1789136162.587244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136162.589025:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644757504 00000100:00100000:0.0:1789136162.589060:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644757504 00000100:00100000:0.0:1789136162.589176:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1789136162.589189:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+27:15907:x1876044644757504:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:0.0:1789136162.589217:0:17754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136162.589247:0:17754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e85 expref: -99 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.589327:0:17754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.589341:0:17754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 28 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.589602:0:17754:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.589621:0:17754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 28 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.589639:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136162.589642:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136162.589646:0:17754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 28 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136162.589656:0:17754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae600, rc 0) 00000100:00100000:0.0:1789136162.589752:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15907:x1876044644757504:12345-192.168.201.31@tcp:101:dd.0 Request processed in 565us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.589760:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:2.0:1789136162.804127:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.804191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.804223:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.804274:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.804357:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.804398:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644757632 00000100:00100000:2.0:1789136162.804408:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644757632 00000100:00100000:2.0:1789136162.804459:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:2.0:1789136162.804469:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2390:x1876044644757632:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136162.804539:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2390:x1876044644757632:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136162.804558:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:2.0:1789136162.804608:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.805050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.805074:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136162.805102:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758016 00000100:00100000:2.0:1789136162.805106:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758016 00000100:00100000:2.0:1789136162.805148:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758528 00000100:00100000:2.0:1789136162.805152:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758528 00000100:00100000:2.0:1789136162.805173:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644757888 00000100:00100000:2.0:1789136162.805177:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644757888 00000100:00100000:0.0:1789136162.805189:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644757760 00000100:00100000:2.0:1789136162.805196:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758400 00000100:00100000:0.0:1789136162.805206:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644757760 00000100:00100000:2.0:1789136162.805207:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758400 00000100:00100000:2.0:1789136162.805236:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:2.0:1789136162.805250:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644758016:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136162.805288:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758272 00000100:00100000:0.0:1789136162.805295:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758272 00000100:00100000:2.0:1789136162.805301:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644758016:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 56us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136162.805313:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789136162.805319:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758144 00000100:00100000:0.0:1789136162.805324:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758144 00000100:00100000:2.0:1789136162.805344:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1789136162.805359:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:2.0:1789136162.805362:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644758528:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136162.805378:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644757760:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136162.805416:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644758528:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 59us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136162.805426:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:2.0:1789136162.805444:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:2.0:1789136162.805453:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644757888:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136162.805461:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644757760:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 88us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.805472:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:2.0:1789136162.805492:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644757888:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 38us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136162.805502:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1789136162.805518:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:2.0:1789136162.805528:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1789136162.805534:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644758272:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136162.805555:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644758400:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136162.805604:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644758272:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 76us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136162.805617:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644758400:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 68us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.805622:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:0.0:1789136162.805647:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:2.0:1789136162.805649:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1789136162.805661:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:2390:x1876044644758144:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:2.0:1789136162.805681:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136162.805688:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136162.805708:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+12:2390:x1876044644758144:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 51us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136162.805719:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00010000:00010000:0.0:1789136163.176150:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136163.432117:0:17787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789136163.432129:0:17787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136163.432158:0:17787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789136163.432168:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789136163.432307:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3a7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17787:1876044666877056:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789136163.432414:0:17787:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa56d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136163.450298:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3a7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17787:1876044666877056:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789136163.453367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.453529:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758656 00000100:00100000:0.0:1789136163.453567:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758656 00000100:00100000:0.0:1789136163.453652:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1789136163.453664:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15908:x1876044644758656:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789136163.453698:0:17753:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789136163.453819:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15908:x1876044644758656:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 157us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.453828:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00080000:2.0:1789136163.454126:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136163.461963:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.467191:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644758784 00000100:00100000:0.0:1789136163.467210:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644758784 00000100:00100000:0.0:1789136163.467301:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:0.0:1789136163.467324:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15908:x1876044644758784:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.467405:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467441:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467455:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467702:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467712:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467719:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467745:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467754:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467761:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136163.467897:0:17755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789136163.467902:0:17755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136163.467918:0:17755:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467930:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467946:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467953:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467959:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.467963:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467970:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467983:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789136163.467986:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.467991:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.467998:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de42ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.468011:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.468017:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.468023:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.468028:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.468036:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.468999:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469013:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90a7fa59e000) 00010000:00010000:0.0:1789136163.469016:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.469020:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469026:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de42f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469058:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469064:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469070:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469075:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.469079:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469085:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469092:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136163.469095:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.469108:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.469115:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de42f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136163.469219:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15908:x1876044644758784:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 1904us (7261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.469228:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:3.0:1789136163.479165:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.479286:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644759040 00000100:00100000:0.0:1789136163.479296:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644759040 00000100:00100000:0.0:1789136163.479381:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:0.0:1789136163.479392:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+28:15908:x1876044644759040:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.479414:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.479438:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de42ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e8c expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479574:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479592:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479604:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136163.479616:0:17753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789136163.479698:0:17753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479706:0:17753:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479727:0:17753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479747:0:17753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.479752:0:17753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479762:0:17753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479781:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136163.479784:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789136163.479789:0:17753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479795:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4306 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479836:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de42ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e8c expref: 30 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479847:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:0.0:1789136163.479849:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789136163.479889:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de42ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e8c expref: 30 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.479900:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae200, rc 0) 00000100:00100000:0.0:1789136163.479955:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+29:15908:x1876044644759040:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 565us (800us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789136163.479971:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1789136163.498566:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136163.498727:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644759168 00000100:00100000:1.0:1789136163.498736:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644759168 00000100:00100000:1.0:1789136163.498809:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:1.0:1789136163.498820:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+29:15908:x1876044644759168:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789136163.498913:0:18920:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789136163.499256:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+29:15908:x1876044644759168:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 222us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.499265:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:3.0:1789136163.526135:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.530328:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644759424 00000100:00100000:0.0:1789136163.530344:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644759424 00000100:00100000:0.0:1789136163.530424:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:0.0:1789136163.530436:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+29:15908:x1876044644759424:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.530459:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.530492:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4314 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e93 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789136163.530966:0:17753:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1789136163.530973:0:17753:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1789136163.531168:0:17753:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789136163.531324:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de431b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.531340:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de431b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.531353:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de431b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.531415:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4314 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e93 expref: 32 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.531435:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de431b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e93 expref: 31 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.531444:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e000) 00010000:00010000:0.0:1789136163.532204:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136163.532210:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae800, rc 0) 00000100:00100000:0.0:1789136163.532283:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+31:15908:x1876044644759424:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1847us (6157us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789136163.532293:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:3.0:1789136163.551034:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.551217:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644759680 00000100:00100000:0.0:1789136163.551227:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644759680 00000100:00100000:0.0:1789136163.551288:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:0.0:1789136163.551299:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+31:15908:x1876044644759680:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.551372:0:17755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136163.551399:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de431b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e93 expref: 31 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551420:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e000) 00010000:00010000:0.0:1789136163.551631:0:17755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789136163.551659:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551674:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551685:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551699:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551707:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551734:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551805:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551814:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.551823:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552016:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.552022:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552032:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552120:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:0.0:1789136163.552124:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.552129:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552135:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de4329 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552145:0:17755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552152:0:17755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552166:0:17755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552172:0:17755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.552175:0:17755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552182:0:17755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552191:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x75ad8235 (ffff90a7fa59ea00) 00010000:00010000:0.0:1789136163.552194:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.552197:0:17755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.552204:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4330 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x75ad8235 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136163.552305:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+30:15908:x1876044644759680:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1005us (1280us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136163.552522:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:2.0:1789136163.557292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.559214:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644759808 00000100:00100000:0.0:1789136163.559230:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644759808 00000100:00100000:0.0:1789136163.559319:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:0.0:1789136163.559330:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+30:15908:x1876044644759808:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.559351:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.559378:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de4337 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08e9a expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.559439:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de433e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.559454:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de433e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.559466:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de433e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.559594:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de4337 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e9a expref: 32 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.559614:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de433e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e9a expref: 31 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.559622:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:0.0:1789136163.559625:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136163.559628:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:0.0:1789136163.559705:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+31:15908:x1876044644759808:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 376us (2426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.559713:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1789136163.566156:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.576874:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644760064 00000100:00100000:2.0:1789136163.576891:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644760064 00000100:00100000:2.0:1789136163.576972:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:2.0:1789136163.576984:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+31:15908:x1876044644760064:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789136163.577090:0:18920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.577110:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.577123:0:18920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136163.577649:0:18920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1789136163.577660:0:18920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 611696804896ns, next at 612696802493ns, rc = 0 00000004:00010000:2.0:1789136163.577720:0:18920:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005b07abe9 reply state 000000001c4b6e9c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.577738:0:18920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.577766:0:18920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:2.0:1789136163.577769:0:18920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789136163.577774:0:18920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789136163.577994:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+33:15908:x1876044644760064:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1008us (11846us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789136163.578003:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:3.0:1789136163.590246:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.590428:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644760192 00000100:00100000:0.0:1789136163.590438:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644760192 00000100:00100000:0.0:1789136163.590505:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:0.0:1789136163.590517:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+33:15908:x1876044644760192:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.590553:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.590577:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ea1 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.590667:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 34 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.590683:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 34 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.590704:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:0.0:1789136163.590707:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789136163.590713:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caee00, rc 0) 00000100:00100000:0.0:1789136163.590779:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+34:15908:x1876044644760192:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 264us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.590788:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1789136163.596672:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.598056:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644760320 00000100:00100000:2.0:1789136163.598070:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644760320 00000100:00100000:2.0:1789136163.598144:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1789136163.598154:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2392:x1876044644760320:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789136163.598474:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2392:x1876044644760320:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 320us (1814us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789136163.598483:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:3.0:1789136163.608216:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.608574:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644760576 00000100:00100000:2.0:1789136163.608585:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644760576 00000100:00100000:2.0:1789136163.608659:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:2.0:1789136163.608670:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+34:15908:x1876044644760576:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789136163.609211:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+35:15908:x1876044644760576:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 541us (1006us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789136163.609221:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136163.625101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136163.629412:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644760832 00000100:00100000:1.0:1789136163.629427:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644760832 00000100:00100000:2.0:1789136163.635231:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:2.0:1789136163.635246:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+35:15908:x1876044644760832:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789136163.635565:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+35:15908:x1876044644760832:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 319us (10472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.635594:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:1.0:1789136163.646417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.646525:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644760960 00000100:00100000:0.0:1789136163.646546:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644760960 00000100:00100000:0.0:1789136163.646610:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:0.0:1789136163.646620:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+35:15908:x1876044644760960:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.646640:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.646660:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4353 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ea8 expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.646754:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de435a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.646782:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de435a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.646807:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de435a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136163.646851:0:17753:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136163.646913:0:17753:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de435a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.646939:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4353 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea8 expref: 37 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.646958:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de435a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea8 expref: 36 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.646967:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:0.0:1789136163.646970:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789136163.646974:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae200, rc 0) 00000100:00100000:0.0:1789136163.647038:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+36:15908:x1876044644760960:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 419us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.647045:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:3.0:1789136163.652816:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.653016:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644761088 00000100:00100000:0.0:1789136163.653026:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644761088 00000100:00100000:0.0:1789136163.653090:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:0.0:1789136163.653100:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+6:2389:x1876044644761088:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136163.653120:0:20655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.653141:0:20655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08eaf expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136163.653189:0:20655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40d23, blocks: 0x0 00010000:00010000:0.0:1789136163.653211:0:20655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=611s v=(0 0) 00010000:00010000:0.0:1789136163.653216:0:20655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136163.653227:0:20655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 7 pid: 20655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.653248:0:20655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 7 pid: 20655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.653263:0:20655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caea00, rc 0) 00000100:00100000:0.0:1789136163.653339:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2389:x1876044644761088:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 240us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.653346:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:3.0:1789136163.656412:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136163.659011:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644761344 00000100:00100000:1.0:1789136163.659028:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644761344 00000100:00100000:0.0:1789136163.662614:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:0.0:1789136163.662630:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+36:15908:x1876044644761344:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789136163.662758:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+36:15908:x1876044644761344:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 132us (6355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.662776:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1789136163.670158:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.670442:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644761472 00000100:00100000:0.0:1789136163.670452:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644761472 00000100:00100000:0.0:1789136163.670507:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:0.0:1789136163.670518:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+36:15908:x1876044644761472:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789136163.675355:0:17733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789136163.675372:0:17733:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789136163.675427:0:17733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789136163.675471:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675498:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675505:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675511:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.675515:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675522:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675549:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90a7e0aa7a00) 00010000:00010000:0.0:1789136163.675552:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.675556:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675562:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d600/0x559c8745c6de419a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675583:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675590:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675595:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675600:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.675608:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675614:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675622:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:0.0:1789136163.675625:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.675627:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675633:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d000/0x559c8745c6de41a1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675648:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675654:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675659:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675664:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.675667:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675673:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675681:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90a7c3817a00) 00010000:00010000:0.0:1789136163.675683:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.675693:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675699:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fa00/0x559c8745c6de4249 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675718:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675724:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675729:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675735:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.675737:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675743:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675752:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136163.675754:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.675757:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675762:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d200/0x559c8745c6de42ce lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675772:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675786:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675792:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675798:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.675801:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675808:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675816:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:0.0:1789136163.675819:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789136163.675822:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.675841:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de4345 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136163.676030:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+15:15908:x1876044644761472:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 5509us (5878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.676040:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00010000:00010000:2.0:1789136163.676138:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.676147:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.676153:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.676159:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136163.676172:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.676180:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.676190:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:2.0:1789136163.676193:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789136163.676196:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.676202:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e800/0x559c8745c6de41ee lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.676446:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136163.676464:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666877184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789136163.676521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.677117:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877184 00000100:00100000:1.0:1789136163.677126:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877184 00000100:00100000:1.0:1789136163.677207:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136163.677217:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666877184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789136163.677353:0:19267:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789136163.677356:0:19267:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789136163.677358:0:19267:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789136163.677361:0:19267:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789136163 -> 1789136163 00002000:00010000:1.0:1789136163.677363:0:19267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789136163.677406:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1876044666877184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (885us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789136163.677427:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1789136163.677480:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7ff5d43c0/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789136163.677488:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666877184:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1789136163.677612:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136163.681253:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.681335:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644761600 00000100:00100000:2.0:1789136163.681353:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644761600 00000100:00100000:2.0:1789136163.681417:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:2.0:1789136163.681427:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c967bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2390:x1876044644761600:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789136163.681559:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c967bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2390:x1876044644761600:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.681567:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1789136163.687981:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.688308:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644761856 00000100:00100000:2.0:1789136163.688319:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644761856 00000100:00100000:2.0:1789136163.688379:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:2.0:1789136163.688389:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+15:15908:x1876044644761856:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789136163.688444:0:17755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136163.688471:0:17755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de435a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea8 expref: 15 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.688491:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:2.0:1789136163.688496:0:17755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136163.688526:0:17755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.688552:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.688562:0:17755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789136163.688687:0:17755:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000041258063 reply state 00000000a757c195 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.688701:0:17755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.688723:0:17755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:2.0:1789136163.688725:0:17755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789136163.688728:0:17755:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789136163.688829:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:15908:x1876044644761856:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 440us (979us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789136163.688837:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:0.0:1789136163.689300:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666877440:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689402:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.689434:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666877952:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689486:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.689506:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4621a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666878464:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.689565:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789136163.689571:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666877568:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.689611:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666878080:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.689647:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666878592:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.689707:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877440 00000100:00100000:0.0:1789136163.689713:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877440 00000100:00100000:0.0:1789136163.689750:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789136163.689757:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666877440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689803:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666877440:12345-0@lo:400:kworker.0 Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.689812:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789136163.689836:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877952 00000100:00100000:3.0:1789136163.689837:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666877440:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689841:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877952 00000100:00100000:0.0:1789136163.689912:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877568 00000100:00100000:0.0:1789136163.689916:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877568 00000100:00100000:3.0:1789136163.689928:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878080 00000100:00100000:3.0:1789136163.689934:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878080 00000100:00100000:0.0:1789136163.689943:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136163.689953:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4622d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666877952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136163.689964:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136163.689974:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666877568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.689995:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4622d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666877952:12345-0@lo:400:kworker.0 Request processed in 43us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.690003:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136163.690019:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666877568:12345-0@lo:400:kworker.0 Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.690028:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789136163.690149:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878464 00000100:00100000:2.0:1789136163.690154:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878464 00000100:00100000:2.0:1789136163.690179:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878592 00000100:00100000:2.0:1789136163.690182:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878592 00000100:00100000:2.0:1789136163.690198:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789136163.690204:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666878464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136163.690242:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4621e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666878464:12345-0@lo:400:kworker.0 Request processed in 37us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.690248:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789136163.690261:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789136163.690267:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4621680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666878592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.690577:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c9678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666877312:0@lo:400:kworker.0 00000100:00100000:3.0:1789136163.690615:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789136163.690683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.690772:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666877824:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.690799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.690818:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666878336:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.690883:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.690900:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666878848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136163.690924:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.690945:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789136163.690951:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666877696:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.690971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.690981:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666878208:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.690997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.691006:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666878720:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.691026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136163.691047:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878848 00000100:00100000:1.0:1789136163.691051:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878848 00000100:00100000:1.0:1789136163.691080:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136163.691086:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666878848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136163.691109:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136163.691143:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666878848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.691156:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136163.691177:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877824 00000100:00100000:1.0:1789136163.691180:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877824 00000100:00100000:1.0:1789136163.691195:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789136163.691201:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666877824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.691245:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666877824:12345-0@lo:400:kworker.0 Request processed in 44us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.691251:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789136163.691586:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666877824:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.691603:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666878848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136163.691627:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878336 00000100:00100000:1.0:1789136163.691630:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878336 00000100:00100000:1.0:1789136163.691650:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877696 00000100:00100000:1.0:1789136163.691652:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877696 00000100:00100000:1.0:1789136163.691660:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878208 00000100:00100000:1.0:1789136163.691662:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878208 00000100:00100000:1.0:1789136163.691670:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878720 00000100:00100000:1.0:1789136163.691671:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878720 00000100:00100000:1.0:1789136163.691685:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789136163.691690:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666878336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.691723:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666878336:12345-0@lo:400:kworker.0 Request processed in 33us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.691728:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789136163.691747:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666878336:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.691760:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789136163.691955:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666877696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.691993:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666877696:12345-0@lo:400:kworker.0 Request processed in 42us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.691999:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789136163.692018:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666877696:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.692031:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136163.692036:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa399680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666878208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.692063:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa399680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666878208:12345-0@lo:400:kworker.0 Request processed in 27us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.692069:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136163.692087:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666878208:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.692100:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789136163.692106:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666878720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.692134:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666878720:12345-0@lo:400:kworker.0 Request processed in 29us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.692139:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1789136163.692159:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4620000 x1876044666878720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136163.692170:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666878720:0@lo:400:kworker.0 00000100:00100000:3.0:1789136163.692540:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666877312 00000100:00100000:3.0:1789136163.692547:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666877312 00000100:00100000:3.0:1789136163.692587:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789136163.692595:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f55f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3639:x1876044666877312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136163.692638:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f55f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3639:x1876044666877312:12345-0@lo:400:kworker.0 Request processed in 44us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136163.692644:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789136163.692718:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c9678f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666877312:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.692888:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c46221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666878080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.692932:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c46221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666878080:12345-0@lo:400:kworker.0 Request processed in 2896us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.692940:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789136163.692973:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136163.692979:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136163.692982:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789136163.692984:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136163.692994:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136163.693008:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f6b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666878976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136163.693045:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.693079:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666878976 00000100:00100000:0.0:1789136163.693083:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666878976 00000100:00100000:0.0:1789136163.693112:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136163.693120:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666878976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789136163.693135:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136163.693183:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666878976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.693190:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789136163.693228:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666877568:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.693238:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666878080:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.693248:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666878592:0@lo:400:kworker.0 00000100:00100000:0.0:1789136163.693262:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666877952:0@lo:400:kworker.0 00010000:00080000:0.0:1789136163.693276:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4621a40 x1876044666878464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136163.693303:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4621a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666878464:0@lo:400:kworker.0 00000100:00100000:1.0:1789136163.693638:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f6b03840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666878976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136163.693690:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4621680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666878592:12345-0@lo:400:kworker.0 Request processed in 3421us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.693701:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789136163.713778:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136163.713933:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644761984 00000100:00100000:3.0:1789136163.713943:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644761984 00000100:00100000:3.0:1789136163.714008:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:3.0:1789136163.714018:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa399e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:15908:x1876044644761984:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136163.714038:0:19266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136163.714057:0:19266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08eb6 expref: -99 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.714109:0:19266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.714119:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136163.714123:0:19266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136163.714129:0:19266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 8 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.714162:0:19266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.714177:0:19266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136163.714192:0:19266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19266:1876044666879104:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136163.714515:0:19266:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa56780 going to sleep for 11 seconds 00000100:00100000:3.0:1789136163.717279:0:19266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19266:1876044666879104:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136163.717331:0:19266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 8 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.717357:0:19266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fe00, rc 0) 00000100:00100000:3.0:1789136163.717625:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa399e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+8:15908:x1876044644761984:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 3607us (3866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136163.717656:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:1.0:1789136163.720350:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.720770:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644762112 00000100:00100000:2.0:1789136163.720781:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644762112 00010000:00010000:2.0:1789136163.720839:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.720908:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1789136163.720921:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+8:2391:x1876044644762112:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136163.720955:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136163.720980:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.720995:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.721021:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4361 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eaf expref: 8 pid: 20655 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.721040:0:17740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136163.721045:0:17740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136163.721052:0:17740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 7 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.721062:0:17740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 7 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.721103:0:17740:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 7 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.721119:0:17740:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17740:1876044666879232:192.168.201.31@tcp:105: 00000100:00100000:2.0:1789136163.721231:0:17740:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d182acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136163.733117:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.733233:0:17740:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17740:1876044666879232:192.168.201.31@tcp:105: 00010000:00010000:2.0:1789136163.733263:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136163.733293:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644762240 00000100:00100000:3.0:1789136163.733303:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644762240 00000100:00100000:2.0:1789136163.733348:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+8:2391:x1876044644762112:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 12427us (13009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.733360:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1789136163.733385:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789136163.733399:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2392:x1876044644762240:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789136163.733585:0:19572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789136163.733589:0:19572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789136162 00002000:00010000:3.0:1789136163.733592:0:19572:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789136161 00002000:00010000:3.0:1789136163.733595:0:19572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789136163 -> 1789136162 00002000:00010000:3.0:1789136163.733597:0:19572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789136163.733624:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+8:2392:x1876044644762240:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 229us (518us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789136163.733632:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1789136163.742985:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.743063:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644762368 00000100:00100000:2.0:1789136163.743075:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644762368 00000100:00100000:2.0:1789136163.743146:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:2.0:1789136163.743157:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4621a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+8:2390:x1876044644762368:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789136163.743218:0:20655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.743244:0:20655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 8 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.743253:0:20655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136163.743257:0:20655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789136163.743262:0:20655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.743436:0:20655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 8 pid: 19266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.743543:0:20655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 8 pid: 19266 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.743563:0:20655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20655:1876044666879360:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136163.743717:0:20655:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d182acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136163.755161:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.755414:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644762496 00000100:00100000:0.0:1789136163.755430:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644762496 00010000:00010000:0.0:1789136163.755470:0:17739:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 9 pid: 19266 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136163.755512:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789136163.755522:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:2391:x1876044644762496:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136163.755547:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136163.755569:0:17739:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 9 pid: 19266 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.755585:0:17739:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 9 pid: 19266 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.755612:0:17739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789136163.755618:0:17739:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789136163.755624:0:17739:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.755635:0:17739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.755659:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136163.755744:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:2391:x1876044644762496:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 222us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.755753:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00010000:00010000:2.0:1789136163.756067:0:20655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3297b4d/0x559c8745c6de436f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08eb6 expref: 8 pid: 19266 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.756087:0:20655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20655:1876044666879360:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136163.756110:0:20655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756122:0:20655:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756129:0:20655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756150:0:20655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756158:0:20655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756167:0:20655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756174:0:20655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136163.756179:0:20655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756201:0:20655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756215:0:20655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.756223:0:20655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de4376 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.756278:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4621a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2390:x1876044644762368:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 13122us (13303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.756301:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:1.0:1789136163.763249:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.763347:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644762752 00000100:00100000:2.0:1789136163.763358:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644762752 00000100:00100000:2.0:1789136163.763425:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:2.0:1789136163.763436:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:15908:x1876044644762752:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789136163.763517:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.763548:0:17754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 16 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.763559:0:17754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.763595:0:17754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 16 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.763627:0:17754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 16 pid: 17754 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.763643:0:17754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17754:1876044666879488:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136163.763736:0:17754:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d182acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136163.767037:0:17754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17754:1876044666879488:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136163.767072:0:17754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136163.774031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136163.774369:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644762880 00000100:00100000:2.0:1789136163.774382:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644762880 00010000:00010000:2.0:1789136163.774425:0:17740:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 17 pid: 17754 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136163.774471:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1789136163.774480:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+17:2392:x1876044644762880:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136163.774496:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136163.774502:0:17740:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 17 pid: 17754 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774516:0:17740:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 17 pid: 17754 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774550:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de42c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e77 expref: 17 pid: 17754 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774587:0:17740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136163.774593:0:17740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 16 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774605:0:17740:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774613:0:17740:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774620:0:17740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136163.774651:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136163.774705:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:2392:x1876044644762880:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 226us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136163.774713:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00010000:00010000:1.0:1789136163.775501:0:17754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.775513:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.775732:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.775748:0:17754:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 16 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.775757:0:17754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.778843:0:17754:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 16 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.779006:0:17754:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 16 pid: 17753 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136163.779026:0:17754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17754:1876044666879616:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789136163.779197:0:17754:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136163.784473:0:17754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17754:1876044666879616:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789136163.784504:0:17754:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136163.787498:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136163.787827:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763008 00000100:00100000:1.0:1789136163.787838:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763008 00010000:00010000:1.0:1789136163.787924:0:17738:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 17 pid: 17753 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136163.787971:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:1.0:1789136163.787983:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c10992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+17:2392:x1876044644763008:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136163.787999:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136163.788008:0:17738:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 17 pid: 17753 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.788023:0:17738:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 17 pid: 17753 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.788063:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caee00/0x559c8745c6de434c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ea1 expref: 17 pid: 17753 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.788079:0:17738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:1.0:1789136163.788085:0:17738:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.788096:0:17738:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.788103:0:17738:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136163.788125:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136163.788182:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c10992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:2392:x1876044644763008:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 200us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.788189:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00010000:00010000:0.0:1789136163.788730:0:17754:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.788739:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789136163.788850:0:17754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789136163.789003:0:17754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789136163.789036:0:17754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789136163.789115:0:17754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17754:1876044666879744:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789136163.789172:0:17754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136163.789205:0:17754:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2225d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136163.789902:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666879744 00000100:00100000:1.0:1789136163.789910:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666879744 00000100:00100000:1.0:1789136163.789956:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789136163.789965:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17754:x1876044666879744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789136163.790117:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4620780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17754:x1876044666879744:12345-0@lo:1000:mdt00_001.0 Request processed in 152us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136163.790125:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789136163.791984:0:17754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17754:1876044666879744:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789136163.792203:0:17754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789136163.792406:0:17754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10983c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17754:1876044666879872:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789136163.792576:0:17754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136163.792663:0:17754:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136163.792717:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666879872 00000100:00100000:1.0:1789136163.792724:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666879872 00000100:00100000:1.0:1789136163.792951:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789136163.792962:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17754:x1876044666879872:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789136163.793152:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17754:x1876044666879872:12345-0@lo:1000:mdt00_001.0 Request processed in 191us (575us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789136163.793160:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789136163.793233:0:17754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10983c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17754:1876044666879872:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789136163.793294:0:17754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793316:0:17754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793337:0:17754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793343:0:17754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136163.793349:0:17754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793358:0:17754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793378:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:3.0:1789136163.793381:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136163.793386:0:17754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793392:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167c400/0x559c8745c6de4384 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793425:0:17754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793432:0:17754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793437:0:17754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793442:0:17754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167da00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136163.793445:0:17754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793463:0:17754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793472:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136163.793475:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136163.793482:0:17754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 19 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793494:0:17754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 19 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793503:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 19 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.793574:0:17754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 19 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136163.793587:0:17754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17754:1876044666880000:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789136163.793667:0:17754:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136163.797326:0:17754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17754:1876044666880000:192.168.201.31@tcp:105: 00010000:00010000:0.0:1789136163.797372:0:17754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797383:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167da00/0x559c8745c6de42dc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797424:0:17754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797440:0:17754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797452:0:17754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797463:0:17754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797468:0:17754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797474:0:17754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797478:0:17754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.797482:0:17754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797489:0:17754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797499:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136163.797506:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136163.797511:0:17754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797516:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de438b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797526:0:17754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797543:0:17754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797548:0:17754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797553:0:17754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136163.797555:0:17754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797560:0:17754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797568:0:17754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136163.797570:0:17754:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136163.797573:0:17754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.797578:0:17754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879000/0x559c8745c6de437d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17754 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136163.797736:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+19:15908:x1876044644762752:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 34300us (34494us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789136163.797753:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000020:00080000:0.0:1789136163.797759:0:17754:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789136163.798024:0:17787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789136163.798030:0:17787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789136163.798044:0:17787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789136163.798050:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789136163.798372:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.798703:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763136 00000100:00100000:0.0:1789136163.798712:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763136 00000100:00100000:0.0:1789136163.798778:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789136163.798788:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+19:15907:x1876044644763136:12345-192.168.201.31@tcp:49:dd.0 00000100:00100000:0.0:1789136163.798947:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+19:15907:x1876044644763136:12345-192.168.201.31@tcp:49:dd.0 Request processed in 160us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.798954:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1789136163.803798:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.804177:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763264 00000100:00100000:0.0:1789136163.804189:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763264 00000100:00100000:0.0:1789136163.804263:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:0.0:1789136163.804275:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+19:15907:x1876044644763264:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:0.0:1789136163.804311:0:17753:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136163.804337:0:17753:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4392 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ebd expref: -99 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.804377:0:17753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4399 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.804392:0:17753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4399 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.804404:0:17753:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4399 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17753 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.804553:0:17753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae800/0x559c8745c6de4392 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ebd expref: 21 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.804584:0:17753:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4399 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ebd expref: 20 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.804592:0:17753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:0.0:1789136163.804595:0:17753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789136163.804598:0:17753:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caea00, rc 0) 00000100:00100000:0.0:1789136163.804664:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+20:15907:x1876044644763264:12345-192.168.201.31@tcp:101:dd.0 Request processed in 391us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136163.804671:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:3.0:1789136163.804946:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.805087:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763520 00000100:00100000:0.0:1789136163.805093:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763520 00000100:00100000:0.0:1789136163.805123:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789136163.805131:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+20:15908:x1876044644763520:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789136163.810007:0:17757:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789136163.810055:0:17757:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789136163.810119:0:17757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.810139:0:17757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.810152:0:17757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.810162:0:17757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.810170:0:17757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.810195:0:17757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.810217:0:17757:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789136163.810357:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+22:15908:x1876044644763520:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 5220us (5406us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789136163.810371:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000020:00080000:0.0:1789136163.810379:0:17757:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789136163.815074:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136163.815091:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.815102:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136163.815125:0:17742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.815135:0:17742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.815156:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:3.0:1789136163.815169:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789136163.815176:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.815183:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae200/0x559c8745c6de43a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17757 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136163.815200:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136163.815202:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136163.815204:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136163.989191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136163.989300:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763648 00000100:00100000:0.0:1789136163.989322:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763648 00000100:00100000:0.0:1789136163.989392:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1789136163.989404:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2391:x1876044644763648:12345-192.168.201.31@tcp:4:dd.0 00002000:00010000:0.0:1789136163.989455:0:19270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa40d22, atime: 0x6aa40d21, ctime: 0x6aa40d22, blocks: 0x0 00010000:00010000:0.0:1789136163.989464:0:19270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.989480:0:19270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1789136163.989485:0:19270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136163.989491:0:19270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136163.989507:0:19270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136164.009391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136164.013361:0:19272:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789136164.013382:0:19272:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789136164.016437:0:19272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763776 00000100:00100000:1.0:1789136164.016452:0:19272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763776 00000100:00080000:1.0:1789136164.016544:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136164.018756:0:20906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:2.0:1789136164.018782:0:20906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+9:2392:x1876044644763776:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:2.0:1789136164.018831:0:20906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.018851:0:20906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136164.018882:0:20906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136164.018888:0:20906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.018903:0:20906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789136164.130660:0:19261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1789136164.130682:0:19261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1789136164.131235:0:19270:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1789136164.131351:0:19270:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789136162 -> 1789136163 00002000:00010000:0.0:1789136164.131353:0:19270:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789136162 -> 1789136163 00002000:00010000:0.0:1789136164.131356:0:19270:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1789136164.131377:0:19270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136164.131390:0:19270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136164.131400:0:19270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136164.131407:0:19270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136164.131412:0:19270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136164.131422:0:19270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136164.131443:0:19270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136164.131451:0:19270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb1d3ec/0x559c8745c6de43a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136164.131568:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+7:2391:x1876044644763648:12345-192.168.201.31@tcp:4:dd.0 Request processed in 142159us (142379us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789136164.131580:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000001:00080000:0.0:1789136164.171400:0:19261:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789136164.171727:0:20906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789136164.171733:0:20906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789136164.171751:0:20906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.171765:0:20906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.171773:0:20906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.171781:0:20906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136164.171785:0:20906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.171795:0:20906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.171815:0:20906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136164.171841:0:20906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000976b7a48/0x559c8745c6de43ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136164.172021:0:20906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2392:x1876044644763776:12345-192.168.201.31@tcp:4:dd.0 Request processed in 153245us (162634us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789136164.172032:0:20906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00010000:00010000:0.0:1789136164.200760:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136164.712413:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666880128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136164.712489:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136164.712886:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880128 00000100:00100000:2.0:1789136164.712894:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880128 00000100:00100000:2.0:1789136164.712943:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136164.712951:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666880128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136164.712975:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923509248 avail 3684282368 00000100:00100000:2.0:1789136164.713029:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666880128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136164.713036:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136164.713136:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789136164.713143:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7ff5d43c0, transno 8589934596 00000004:00080000:1.0:1789136164.713162:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789136164.713187:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666880128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136165.232838:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136165.736229:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136165.736257:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666880256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136165.736338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136165.736528:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666880384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136165.736583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136165.736708:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880384 00000100:00100000:0.0:1789136165.736717:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880384 00000100:00080000:2.0:1789136165.736764:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136165.736787:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789136165.736800:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5675680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666880384:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136165.736824:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880256 00002000:00000024:0.0:1789136165.736827:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923509248 avail 3684282368 00000100:00100000:1.0:1789136165.736829:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880256 00000100:00100000:1.0:1789136165.736880:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789136165.736948:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666880256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136165.736977:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789136165.740669:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666880256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3768us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136165.740691:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789136165.743516:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5675680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666880384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6700us (6912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136165.743534:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136165.743615:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666880384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136165.743635:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666880256:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1789136165.914665:0:20943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1789136166.251163:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136166.251189:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666880512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136166.251277:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136166.251328:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880512 00000100:00100000:0.0:1789136166.251336:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880512 00000100:00100000:0.0:1789136166.251385:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789136166.251394:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666880512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136166.251432:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136166.251526:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666880512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136166.251533:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789136166.251580:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666880512:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789136166.264975:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136167.019028:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136167.272446:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136167.933732:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136167.935924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136167.935982:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136167.936018:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136167.936070:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764160 00000100:00100000:1.0:1789136167.936093:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764160 00000100:00100000:1.0:1789136167.936175:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764032 00000100:00100000:1.0:1789136167.936179:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764032 00000100:00100000:1.0:1789136167.936208:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:1.0:1789136167.936220:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644764160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136167.936322:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644764160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.936331:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:1.0:1789136167.936355:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:1.0:1789136167.936362:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+22:2390:x1876044644764032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136167.936396:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+22:2390:x1876044644764032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 34us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.936403:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:1.0:1789136167.936425:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764288 00000100:00100000:1.0:1789136167.936429:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764288 00000100:00100000:1.0:1789136167.936784:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:1.0:1789136167.936796:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644764288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136167.937068:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6b03840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644764288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 274us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.937136:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00080000:1.0:1789136167.937167:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136167.937173:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136167.937176:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136167.945271:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644763904 00000100:00100000:0.0:1789136167.945292:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644763904 00000100:00100000:3.0:1789136167.951547:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136167.951599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136167.952480:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764416 00000100:00100000:0.0:1789136167.952501:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764416 00000100:00100000:0.0:1789136167.952623:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1789136167.952640:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5675e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2388:x1876044644764416:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:0.0:1789136167.952702:0:19267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de409e 00000100:00080000:0.0:1789136167.952725:0:19267:0:(import.c:65:import_set_state_nolock()) ffff90a7c6311000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136167.952791:0:19267:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1789136167.953355:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136167.957426:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:1.0:1789136167.957446:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2390:x1876044644763904:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136167.964322:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5675e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+2:2388:x1876044644764416:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 11664us (12771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136167.964348:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00010000:00010000:0.0:1789136167.964509:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136167.966279:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2390:x1876044644763904:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 8820us (32547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.966302:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:1.0:1789136167.974446:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764544 00000100:00100000:1.0:1789136167.974476:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764544 00000100:00100000:1.0:1789136167.974618:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:1.0:1789136167.974651:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5676940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2390:x1876044644764544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136167.974762:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5676940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2390:x1876044644764544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 113us (23162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.974788:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00080000:1.0:1789136167.974829:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136167.987024:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136167.987065:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136167.987356:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764672 00000100:00100000:1.0:1789136167.987370:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764672 00000100:00100000:3.0:1789136167.987576:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764800 00000100:00100000:3.0:1789136167.987592:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764800 00000100:00100000:3.0:1789136167.987637:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:3.0:1789136167.987650:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c56770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2388:x1876044644764800:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:3.0:1789136167.987694:0:20655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de40d6 00000100:00080000:3.0:1789136167.987713:0:20655:0:(import.c:65:import_set_state_nolock()) ffff90a7fa378000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136167.987797:0:20655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789136167.989443:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c56770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+2:2388:x1876044644764800:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 1785us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136167.989483:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:3.0:1789136167.989666:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136167.991149:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:1.0:1789136167.991178:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5674f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644764672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136167.991267:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5674f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644764672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 103us (4258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.991275:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00080000:1.0:1789136167.991325:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136167.991334:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789136167.991352:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136167.991371:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644764928 00000100:00100000:1.0:1789136167.991381:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644764928 00000100:00100000:1.0:1789136167.991435:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1789136167.991442:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5675a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2388:x1876044644764928:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:1.0:1789136167.991500:0:19572:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de40dd 00000100:00080000:1.0:1789136167.991512:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a7fa378800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136167.991567:0:19572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789136167.991702:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5675a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+2:2388:x1876044644764928:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 259us (2036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136167.991709:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00080000:1.0:1789136167.991724:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789136167.991779:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 46075 lines, 46075 kept, 0 dropped, 0 bad.